Log In Sign Up

haysnewsdispatch.com
robots.txt

Robots Exclusion Standard data for haysnewsdispatch.com

Resource Scan

Scan Details

Site Domain haysnewsdispatch.com
Base Domain haysnewsdispatch.com
Scan Status Ok
Last Scan2024-06-23T08:05:29+00:00
Next Scan 2024-06-30T08:05:29+00:00

Last Scan

Scanned2024-06-23T08:05:29+00:00
URL http://haysnewsdispatch.com/robots.txt
Domain IPs 104.237.136.26
Response IP 104.237.136.26
Found Yes
Hash 328a9f02e00751ebc695bfcbd3658124257329750931e39eb3725403b1a15523
SimHash 005cca32a772

Groups

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com

Rule Path
Disallow /

mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /

html validator by siteimprove.com/1.3

Rule Path
Disallow /
Back to top