legeland.dk
robots.txt

Robots Exclusion Standard data for legeland.dk

Resource Scan

Scan Details

Site Domain legeland.dk
Base Domain legeland.dk
Scan Status Ok
Last Scan2025-05-20T20:48:25+00:00
Next Scan 2025-06-19T20:48:25+00:00

Last Scan

Scanned2025-05-20T20:48:25+00:00
URL https://legeland.dk/robots.txt
Redirect https://www.legeland.dk/robots.txt
Redirect Domain www.legeland.dk
Redirect Base legeland.dk
Domain IPs 185.21.41.98
Redirect IPs 185.21.41.98
Response IP 185.21.41.98
Found Yes
Hash 94ba4a57647d2233def04f3af3136b8ea084949f86446d30b866ab35e280fcd8
SimHash 611b812223a3

Groups

lwnutch
dotbot
genieo
buibui-checkbot
siteexplorer
seznambot
eccp
yandexbot
yahoo! slurp
mj12bot

Rule Path
Disallow /

msnbot
bingbot

Rule Path
Allow /
Disallow /admin/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Allow /
Disallow /admin/
Disallow /login/
Disallow /mobile/
Disallow /core/
Allow /core/js/
Disallow /core/js/admin/
Allow /core/builder/js/
Allow /core/builder/css/
Allow /core/css/
Allow /core/fonts/
Allow /core/ajax/
Disallow /core/ajax/admin/
Disallow /*ref%3Dmax*
Disallow /*?page=*

Other Records

Field Value
sitemap https://www.legeland.dk/sitemap.xml

Comments

  • Stop overcrawling bots
  • Disallow: /search/