heycar.nl
robots.txt

Robots Exclusion Standard data for heycar.nl

Resource Scan

Scan Details

Site Domain heycar.nl
Base Domain heycar.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-25T01:21:27+00:00
Next Scan 2024-10-09T01:21:27+00:00

Last Successful Scan

Scanned2024-08-17T22:36:21+00:00
URL http://heycar.nl/robots.txt
Domain IPs 2a01:4f8:221:11cd:9734:4c26:6044:5f33, 88.99.101.251
Response IP 88.99.101.251
Found Yes
Hash c5c99b65f78c08fdf9282aa17b0bf623c757e37d4a353ff61776706b4e506575
SimHash a128dcc0c3a2

Groups

*

Rule Path
Disallow /*/

Other Records

Field Value
crawl-delay 60

Comments

  • robots.txt