theworlddata.com
robots.txt
Robots Exclusion Standard data for theworlddata.com
Resource Scan
Scan Details
| Site Domain | theworlddata.com |
| Base Domain | theworlddata.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-11-21T18:36:16+00:00 |
| Next Scan | 2025-12-05T18:36:16+00:00 |
Last Successful Scan
| Scanned | 2025-11-06T14:45:46+00:00 |
| URL | https://theworlddata.com/robots.txt |
| Domain IPs | 157.173.209.154, 2a02:4780:2b:1663:0:2876:dad5:2 |
| Response IP | 157.173.209.154 |
| Found | Yes |
| Hash | 4af82f572ff921b8413e701719c4bc64f24efcc43a7212ed72157f09b5309cf0 |
| SimHash | 49008840cdb3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://theworlddata.com/sitemap.xml |