centraltxnews.com
robots.txt

Robots Exclusion Standard data for centraltxnews.com

Resource Scan

Scan Details

Site Domain centraltxnews.com
Base Domain centraltxnews.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-01T01:23:34+00:00
Next Scan 2026-03-02T01:23:34+00:00

Last Successful Scan

Scanned2025-11-01T21:35:20+00:00
URL https://centraltxnews.com/robots.txt
Domain IPs 52.86.19.148
Response IP 52.86.19.148
Found Yes
Hash c881ca7b5d2e2e268e7c90d694117e4835154654839e521078364630f947d1d4
SimHash 6711f44545d5

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15