crawfordcountynow.com
robots.txt

Robots Exclusion Standard data for crawfordcountynow.com

Resource Scan

Scan Details

Site Domain crawfordcountynow.com
Base Domain crawfordcountynow.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-09T18:31:31+00:00
Next Scan 2025-02-07T18:31:31+00:00

Last Successful Scan

Scanned2024-01-15T17:58:51+00:00
URL https://crawfordcountynow.com/robots.txt
Domain IPs 34.194.190.118, 34.202.173.169
Response IP 34.194.190.118
Found Yes
Hash c0c7edb38ce374ecf7a1f01da268721ac782dc612347434beeb4b296adb18a7e
SimHash 281d5080e990

Groups

*

Rule Path
Disallow /newsletter/
Disallow /nc/

googlebot

Rule Path
Disallow /halfpriceoutlet/

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /