vasterbottningen.se
robots.txt

Robots Exclusion Standard data for vasterbottningen.se

Resource Scan

Scan Details

Site Domain vasterbottningen.se
Base Domain vasterbottningen.se
Scan Status Ok
Last Scan2024-06-13T09:18:57+00:00
Next Scan 2024-06-20T09:18:57+00:00

Last Scan

Scanned2024-06-13T09:18:57+00:00
URL https://vasterbottningen.se/robots.txt
Redirect https://www.vasterbottningen.se/robots.txt
Redirect Domain www.vasterbottningen.se
Redirect Base vasterbottningen.se
Domain IPs 104.21.74.39, 172.67.197.191, 2606:4700:3031::ac43:c5bf, 2606:4700:3034::6815:4a27
Redirect IPs 104.21.74.39, 172.67.197.191, 2606:4700:3031::ac43:c5bf, 2606:4700:3034::6815:4a27
Response IP 172.67.197.191
Found Yes
Hash 1f0cacbd6e3acfdf590c31697028aa23369595264f0d68eec900bf2bb62e8b37
SimHash 5b0ec9614513

Groups

*

Rule Path
Disallow /wp-*
Disallow /?s*
Disallow /soka
Disallow /sok
Allow *.css
Allow *.js

ccbot
gptbot
chatgpt-user
anthropic-ai
google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vasterbottningen.se/google-news-sitemap.xml
sitemap https://www.vasterbottningen.se/sitemap/native.xml
sitemap https://www.vasterbottningen.se/sitemap/2018.xml
sitemap https://www.vasterbottningen.se/sitemap/2019.xml
sitemap https://www.vasterbottningen.se/sitemap/2020.xml
sitemap https://www.vasterbottningen.se/sitemap/2021.xml
sitemap https://www.vasterbottningen.se/sitemap/2022.xml
sitemap https://www.vasterbottningen.se/sitemap/2023.xml
sitemap https://www.vasterbottningen.se/sitemap/2024.xml