cru.org
robots.txt
Robots Exclusion Standard data for cru.org
Resource Scan
Scan Details
| Site Domain | cru.org |
| Base Domain | cru.org |
| Scan Status | Ok |
| Last Scan | 2024-05-04T02:05:39+00:00 |
| Next Scan | 2024-06-03T02:05:39+00:00 |
Last Scan
| Scanned | 2024-05-04T02:05:39+00:00 |
| URL | https://cru.org/robots.txt |
| Redirect | https://www.cru.org:443/robots.txt |
| Redirect Domain | www.cru.org |
| Redirect Base | cru.org |
| Domain IPs | 13.226.228.123, 13.226.228.14, 13.226.228.41, 13.226.228.98, 2600:9000:2201:3800:c:b2e8:af80:93a1, 2600:9000:2201:4a00:c:b2e8:af80:93a1, 2600:9000:2201:5800:c:b2e8:af80:93a1, 2600:9000:2201:6800:c:b2e8:af80:93a1, 2600:9000:2201:7a00:c:b2e8:af80:93a1, 2600:9000:2201:800:c:b2e8:af80:93a1, 2600:9000:2201:8200:c:b2e8:af80:93a1, 2600:9000:2201:e000:c:b2e8:af80:93a1 |
| Redirect IPs | 13.226.228.123, 13.226.228.14, 13.226.228.41, 13.226.228.98 |
| Response IP | 18.165.171.117 |
| Found | Yes |
| Hash | 96be0f83d40959da46e21066fbf57bb08dd0e69bc308a97b4b84558fde0670b5 |
| SimHash | 29090cdccb13 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cru.org/sitemap.xml |