businesinsider.nl
robots.txt

Robots Exclusion Standard data for businesinsider.nl

Resource Scan

Scan Details

Site Domain businesinsider.nl
Base Domain businesinsider.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-29T14:16:32+00:00
Next Scan 2024-06-27T14:16:32+00:00

Last Successful Scan

Scanned2022-12-01T04:07:46+00:00
URL http://businesinsider.nl/robots.txt
Redirect https://www.businessinsider.nl/robots.txt
Redirect Domain www.businessinsider.nl
Redirect Base businessinsider.nl
Domain IPs 178.62.205.171
Redirect IPs 178.62.205.171
Response IP 178.62.205.171
Found Yes
Hash 7376b5dde44004a4b57aa138df9a20fab33bd8f78cea5cffcebb5674da68ce73
SimHash 4100c8004bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php