bbcearth.com
robots.txt
Robots Exclusion Standard data for bbcearth.com
Resource Scan
Scan Details
| Site Domain | bbcearth.com |
| Base Domain | bbcearth.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-24T08:45:04+00:00 |
| Next Scan | 2024-07-23T08:45:04+00:00 |
Last Successful Scan
| Scanned | 2023-09-28T08:26:28+00:00 |
| URL | https://bbcearth.com/robots.txt |
| Redirect | https://www.bbcearth.com/robots.txt |
| Redirect Domain | www.bbcearth.com |
| Redirect Base | bbcearth.com |
| Domain IPs | 18.201.0.224, 52.212.159.195, 52.213.182.76 |
| Redirect IPs | 23.193.172.42, 23.193.172.51, 2600:1413:b000:1c::17d1:2ed5, 2600:1413:b000:1c::17d1:2edf |
| Response IP | 23.64.122.33 |
| Found | Yes |
| Hash | 0cfd124543b3c75bd7302b40a1fc38826239308c056a5687054bd9234dbd23f8 |
| SimHash | 4118d557c713 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bbcearth.com/sitemap.xml |