vasterbottningen.se
robots.txt

Robots Exclusion Standard data for vasterbottningen.se

Resource Scan

Scan Details

Site Domain vasterbottningen.se
Base Domain vasterbottningen.se
Scan Status Ok
Last Scan2024-11-14T22:47:10+00:00
Next Scan 2024-11-21T22:47:10+00:00

Last Scan

Scanned2024-11-14T22:47:10+00:00
URL https://vasterbottningen.se/robots.txt
Redirect https://www.vasterbottningen.se/robots.txt
Redirect Domain www.vasterbottningen.se
Redirect Base vasterbottningen.se
Domain IPs 104.26.2.125, 104.26.3.125, 172.67.69.168, 2606:4700:20::681a:27d, 2606:4700:20::681a:37d, 2606:4700:20::ac43:45a8
Redirect IPs 104.26.2.125, 104.26.3.125, 172.67.69.168, 2606:4700:20::681a:27d, 2606:4700:20::681a:37d, 2606:4700:20::ac43:45a8
Response IP 104.26.2.125
Found Yes
Hash 1f0cacbd6e3acfdf590c31697028aa23369595264f0d68eec900bf2bb62e8b37
SimHash 5b0ec9614513

Groups

*

Rule Path
Disallow /wp-*
Disallow /?s*
Disallow /soka
Disallow /sok
Allow *.css
Allow *.js

ccbot
gptbot
chatgpt-user
anthropic-ai
google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vasterbottningen.se/google-news-sitemap.xml
sitemap https://www.vasterbottningen.se/sitemap/native.xml
sitemap https://www.vasterbottningen.se/sitemap/2018.xml
sitemap https://www.vasterbottningen.se/sitemap/2019.xml
sitemap https://www.vasterbottningen.se/sitemap/2020.xml
sitemap https://www.vasterbottningen.se/sitemap/2021.xml
sitemap https://www.vasterbottningen.se/sitemap/2022.xml
sitemap https://www.vasterbottningen.se/sitemap/2023.xml
sitemap https://www.vasterbottningen.se/sitemap/2024.xml