cancer.gov
robots.txt
Robots Exclusion Standard data for cancer.gov
Resource Scan
Scan Details
| Site Domain | cancer.gov |
| Base Domain | cancer.gov |
| Scan Status | Ok |
| Last Scan | 2025-03-24T17:20:03+00:00 |
| Next Scan | 2025-04-23T17:20:03+00:00 |
Last Scan
| Scanned | 2025-03-24T17:20:03+00:00 |
| URL | https://cancer.gov/robots.txt |
| Redirect | https://www.cancer.gov/robots.txt |
| Redirect Domain | www.cancer.gov |
| Redirect Base | cancer.gov |
| Domain IPs | 129.43.254.31, 2607:f220:41d:21c1::812b:fe1f |
| Redirect IPs | 23.32.29.104, 23.32.29.90, 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2be0 |
| Response IP | 23.35.148.194 |
| Found | Yes |
| Hash | 61f213d2ad6b1c8b76c5bf7694d636ae0a7a6df2e32dc1cab1b24cef08b4c9ea |
| SimHash | 6504dd54cd93 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cancer.gov/sitemap.xml |