chrw.io
robots.txt

Robots Exclusion Standard data for chrw.io

Resource Scan

Scan Details

Site Domain chrw.io
Base Domain chrw.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-05T06:40:12+00:00
Next Scan 2025-09-03T06:40:12+00:00

Last Successful Scan

Scanned2024-08-02T22:23:48+00:00
URL http://chrw.io/robots.txt
Redirect http://chrw.io/robots.txt?rb.routing.mode=proxy&rb.routing.signature=928349
Domain IPs 52.72.49.79
Response IP 52.72.49.79
Found Yes
Hash 2a7bbf0e5783258cf032a441eee7aa8960f805d56dd64fe09cbc61fba23806f0
SimHash 65448140c3b1

Groups

*

Rule Path
Disallow /$
Allow /*