hellocresthill.com
robots.txt

Robots Exclusion Standard data for hellocresthill.com

Resource Scan

Scan Details

Site Domain hellocresthill.com
Base Domain hellocresthill.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-10T12:43:40+00:00
Next Scan 2024-07-09T12:43:40+00:00

Last Successful Scan

Scanned2022-09-27T04:20:19+00:00
URL https://hellocresthill.com/robots.txt
Redirect https://www.hellocresthill.com/robots.txt
Redirect Domain www.hellocresthill.com
Redirect Base hellocresthill.com
Response IP 54.204.17.232, 107.20.168.223, 35.175.61.221, 34.237.241.41, 3.210.68.252, 18.210.55.57
Found Yes
Hash 94bfe20181755338a946df06d704cb18107d75cf9502aa69b2783fbedebe14a5
SimHash 4e54dc40c210

Groups

*

Rule Path
Disallow /intext

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /