mellanbygden.nu
robots.txt

Robots Exclusion Standard data for mellanbygden.nu

Resource Scan

Scan Details

Site Domain mellanbygden.nu
Base Domain mellanbygden.nu
Scan Status Ok
Last Scan2024-11-15T20:44:03+00:00
Next Scan 2024-11-22T20:44:03+00:00

Last Scan

Scanned2024-11-15T20:44:03+00:00
URL https://mellanbygden.nu/robots.txt
Redirect https://www.mellanbygden.nu/robots.txt
Redirect Domain www.mellanbygden.nu
Redirect Base mellanbygden.nu
Domain IPs 104.26.2.89, 104.26.3.89, 172.67.75.81, 2606:4700:20::681a:259, 2606:4700:20::681a:359, 2606:4700:20::ac43:4b51
Redirect IPs 104.26.2.89, 104.26.3.89, 172.67.75.81, 2606:4700:20::681a:259, 2606:4700:20::681a:359, 2606:4700:20::ac43:4b51
Response IP 104.26.3.89
Found Yes
Hash 64da5fa2b42829f0a5939fe1dbfeb215ea13874302ef6e1cf15644f714ac582a
SimHash 040c4961eb13

Groups

*

Rule Path
Disallow /wp-*
Disallow /?s*
Disallow /soka
Disallow /sok
Allow *.css
Allow *.js

ccbot
gptbot
chatgpt-user
anthropic-ai
google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mellanbygden.nu/google-news-sitemap.xml
sitemap https://www.mellanbygden.nu/sitemap/native.xml
sitemap https://www.mellanbygden.nu/sitemap/2018.xml
sitemap https://www.mellanbygden.nu/sitemap/2019.xml
sitemap https://www.mellanbygden.nu/sitemap/2020.xml
sitemap https://www.mellanbygden.nu/sitemap/2021.xml
sitemap https://www.mellanbygden.nu/sitemap/2022.xml
sitemap https://www.mellanbygden.nu/sitemap/2023.xml
sitemap https://www.mellanbygden.nu/sitemap/2024.xml