turorientering.no
robots.txt

Robots Exclusion Standard data for turorientering.no

Resource Scan

Scan Details

Site Domain turorientering.no
Base Domain turorientering.no
Scan Status Ok
Last Scan2025-11-03T01:06:32+00:00
Next Scan 2025-12-03T01:06:32+00:00

Last Scan

Scanned2025-11-03T01:06:32+00:00
URL https://turorientering.no/robots.txt
Redirect https://www.turorientering.no/robots.txt
Redirect Domain www.turorientering.no
Redirect Base turorientering.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 176.111.200.83
Response IP 176.111.200.83
Found Yes
Hash ba118b77e126d59d4a181669eabc5b2d35df0bf5b3f56464faa6475871f3304f
SimHash 431cc05bc211

Groups

*

Rule Path
Disallow /error/blackhole
Disallow /storage/
Disallow /fileStorage/

dotbot

Rule Path
Disallow /

googlebot

Rule Path
Allow *.js
Allow *.css

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.turorientering.no/sitemap/events.xml
sitemap https://www.turorientering.no/sitemap/blog.xml
sitemap https://www.turorientering.no/sitemap/classifieds.xml
sitemap https://www.turorientering.no/sitemap/forum.xml
sitemap https://www.turorientering.no/sitemap/pages.xml