netnationen.dk
robots.txt

Robots Exclusion Standard data for netnationen.dk

Resource Scan

Scan Details

Site Domain netnationen.dk
Base Domain netnationen.dk
Scan Status Ok
Last Scan2025-09-26T04:25:45+00:00
Next Scan 2025-10-03T04:25:45+00:00

Last Scan

Scanned2025-09-26T04:25:45+00:00
URL https://netnationen.dk/robots.txt
Domain IPs 104.21.92.130, 172.67.194.35
Response IP 104.21.92.130
Found Yes
Hash 6662aafe72a5244704d01fb917b4f03cc17837906e65df45cbf767d2d4bd6949
SimHash 245499a6429b

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /sign-in/
Disallow /lists/server-population/
Disallow /lists/host-population/
Disallow /lists/pagerank/
Disallow /lists/site-stats/
Disallow /lists/suspended-domains/
Disallow /lists/redirected-domains/
Disallow /search/register/
Disallow /search/properties/
Disallow /search/server/
Disallow /search/platform/
Disallow /search/population/
Disallow /search/host/
Disallow /search/birthday/
Disallow /chart/install/
Disallow /overview/
Disallow /division/
Disallow /register/
Disallow /export/deleted_domain/

psbot
ia_archiver
slurp
jyxobot
psycheclone
turnitinbot
mj12bot
irlbot
gigabot
twiceler
dotbot
speedy
sogou spider
sogou web spider
yandex
zookabot
wbsearchbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.