dans.nl
robots.txt

Robots Exclusion Standard data for dans.nl

Resource Scan

Scan Details

Site Domain dans.nl
Base Domain dans.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-09T00:37:00+00:00
Next Scan 2025-12-08T00:37:00+00:00

Last Successful Scan

Scanned2022-09-06T09:47:51+00:00
URL https://dans.nl/robots.txt
Redirect https://dans-nl.webnode.be/robots.txt
Redirect Domain dans-nl.webnode.be
Redirect Base webnode.be
Response IP 85.132.152.162
Found Yes
Hash 34e683ddb7d0b673dcc0171f2b4346a40f2beeb5349360be6d30a1f82309ea6b
SimHash 6854d8108bf3

Groups

psbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://dans-nl.webnode.be/sitemap.xml