whatdothey.com
robots.txt
Robots Exclusion Standard data for whatdothey.com
Resource Scan
Scan Details
| Site Domain | whatdothey.com |
| Base Domain | whatdothey.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-14T06:54:25+00:00 |
| Next Scan | 2025-11-21T06:54:25+00:00 |
Last Successful Scan
| Scanned | 2025-11-05T15:03:32+00:00 |
| URL | https://whatdothey.com/robots.txt |
| Domain IPs | 2a02:4780:15:353b:ca8b:fbba:db74:b778, 2a02:4780:16:3330:f77d:b47:a760:7ed8, 84.32.84.128, 84.32.84.235 |
| Response IP | 191.101.228.112 |
| Found | Yes |
| Hash | 4cb6d20078b002360db2c50d384f48f30e3b2975a51448746e61e498654c7bd7 |
| SimHash | 4100d8004992 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://whatdothey.com/sitemap_index.xml |