harendekrant.nl
robots.txt

Robots Exclusion Standard data for harendekrant.nl

Resource Scan

Scan Details

Site Domain harendekrant.nl
Base Domain harendekrant.nl
Scan Status Ok
Last Scan2024-11-13T20:59:34+00:00
Next Scan 2024-12-13T20:59:34+00:00

Last Scan

Scanned2024-11-13T20:59:34+00:00
URL https://harendekrant.nl/robots.txt
Redirect https://www.harendekrant.nl/robots.txt
Redirect Domain www.harendekrant.nl
Redirect Base harendekrant.nl
Domain IPs 31.204.147.10
Redirect IPs 31.204.147.10
Response IP 31.204.147.10
Found Yes
Hash ef57ec095efbfec0b525e37fb705e73216d6a8197aee35216b4a9a665ec1a4b9
SimHash 6558dcc0c1b5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60