apps.washingtonexaminer.com
robots.txt

Robots Exclusion Standard data for apps.washingtonexaminer.com

Resource Scan

Scan Details

Site Domain apps.washingtonexaminer.com
Base Domain washingtonexaminer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-20T14:29:09+00:00
Next Scan 2025-07-19T14:29:09+00:00

Last Successful Scan

Scanned2024-06-02T14:27:12+00:00
URL https://apps.washingtonexaminer.com/robots.txt
Domain IPs 104.18.4.91, 104.18.5.91, 2606:4700::6812:45b, 2606:4700::6812:55b
Response IP 104.18.4.91
Found Yes
Hash fc58b4016b8deb94a48cc3d20e2d45c77e188bb3bd3d1c9a357b382e6b41f585
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10