valg.no
robots.txt

Robots Exclusion Standard data for valg.no

Resource Scan

Scan Details

Site Domain valg.no
Base Domain valg.no
Scan Status Ok
Last Scan2025-10-05T09:22:27+00:00
Next Scan 2025-10-19T09:22:27+00:00

Last Scan

Scanned2025-10-05T09:22:27+00:00
URL https://valg.no/robots.txt
Redirect https://www.valg.no/robots.txt
Redirect Domain www.valg.no
Redirect Base valg.no
Domain IPs 217.114.94.2, 2a00:1c50:94::2
Redirect IPs 104.18.40.50, 172.64.147.206, 2606:4700:440c::ac40:93ce, 2a06:98c1:310d::6812:2832
Response IP 172.64.147.206
Found Yes
Hash c6db0bc6650f151b7427bb70e3a0ed6250577979f3e2a05dc74664f1c3af152c
SimHash 6a05581547d7

Groups

*
googlebot

Rule Path
Disallow /arkiv/

slurp

Rule Path
Disallow /arkiv/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /arkiv/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /arkiv/

Other Records

Field Value
crawl-delay 10

duckduckbot

Rule Path
Disallow /arkiv/

Other Records

Field Value
crawl-delay 3

twitterbot

Rule Path
Disallow /arkiv/

*

Rule Path
Disallow /arkiv/

Other Records

Field Value
sitemap https://www.valg.no/sitemap.xml

Comments

  • robots.txt for www.valg.no