esdaw.eu
robots.txt

Robots Exclusion Standard data for esdaw.eu

Resource Scan

Scan Details

Site Domain esdaw.eu
Base Domain esdaw.eu
Scan Status Ok
Last Scan2025-10-21T00:42:50+00:00
Next Scan 2025-11-20T00:42:50+00:00

Last Scan

Scanned2025-10-21T00:42:50+00:00
URL https://esdaw.eu/robots.txt
Redirect https://www.esdaw.eu/robots.txt
Redirect Domain www.esdaw.eu
Redirect Base esdaw.eu
Domain IPs 199.34.228.67
Redirect IPs 199.34.228.67
Response IP 199.34.228.67
Found Yes
Hash c4b2efe4b61d45e5b3c979a7df6459c13312ccfbd4b7fed4bcd69dc62e40132a
SimHash 0844cc760433

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /humans.html
Disallow /business.html
Disallow /tourism.html
Disallow /animals.html
Disallow /the-seven-continents.html
Disallow /europe-and-the-eu.html
Disallow /eu.html

Other Records

Field Value
sitemap https://www.esdaw.eu/sitemap.xml