haysnewsdispatch.com
robots.txt

Robots Exclusion Standard data for haysnewsdispatch.com

Resource Scan

Scan Details

Site Domain haysnewsdispatch.com
Base Domain haysnewsdispatch.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-25T08:08:06+00:00
Next Scan 2024-11-24T08:08:06+00:00

Last Successful Scan

Scanned2024-07-28T08:06:26+00:00
URL http://haysnewsdispatch.com/robots.txt
Domain IPs 104.237.136.26
Response IP 104.237.136.26
Found Yes
Hash 328a9f02e00751ebc695bfcbd3658124257329750931e39eb3725403b1a15523
SimHash 005cca32a772

Groups

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com

Rule Path
Disallow /

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /

html validator by siteimprove.com/1.3

Rule Path
Disallow /