travelthee.com
robots.txt
Robots Exclusion Standard data for travelthee.com
Resource Scan
Scan Details
Site Domain | travelthee.com |
Base Domain | travelthee.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-05T16:48:58+00:00 |
Next Scan | 2025-01-03T16:48:58+00:00 |
Last Successful Scan
Scanned | 2023-08-17T00:57:19+00:00 |
URL | https://www.travelthee.com/robots.txt |
Domain IPs | 104.21.54.168, 172.67.140.173, 2606:4700:3033::ac43:8cad, 2606:4700:3037::6815:36a8 |
Response IP | 172.67.140.173 |
Found | Yes |
Hash | 10054b6cecbe0d8ac013cf3cd3e7807988f9806f83195c9868f6edac3d9afd42 |
SimHash | 4d0d18046df2 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Disallow | /temp |
Other Records
Field | Value |
---|---|
sitemap | http://www.travelthee.com/sitemap.xml |