cntraveller.co.uk
robots.txt
Robots Exclusion Standard data for cntraveller.co.uk
Resource Scan
Scan Details
| Site Domain | cntraveller.co.uk |
| Base Domain | cntraveller.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-17T17:05:59+00:00 |
| Next Scan | 2024-09-24T17:05:59+00:00 |
Last Scan
| Scanned | 2024-09-17T17:05:59+00:00 |
| URL | http://cntraveller.co.uk/robots.txt |
| Redirect | https://www.cntraveller.com/robots.txt |
| Redirect Domain | www.cntraveller.com |
| Redirect Base | cntraveller.com |
| Domain IPs | 52.212.158.33, 54.194.18.35, 54.76.84.245 |
| Redirect IPs | 13.33.88.6, 13.33.88.64, 13.33.88.72, 13.33.88.90, 2600:9000:223b:2000:f:cd47:2e80:93a1, 2600:9000:223b:4800:f:cd47:2e80:93a1, 2600:9000:223b:7200:f:cd47:2e80:93a1, 2600:9000:223b:7400:f:cd47:2e80:93a1, 2600:9000:223b:9600:f:cd47:2e80:93a1, 2600:9000:223b:a200:f:cd47:2e80:93a1, 2600:9000:223b:ae00:f:cd47:2e80:93a1, 2600:9000:223b:c200:f:cd47:2e80:93a1 |
| Response IP | 13.33.88.64 |
| Found | Yes |
| Hash | 902e2e2d9428185f207ac2f4c11c977770ea75380fc5df7f15e71b17efbdf300 |
| SimHash | 05008143e616 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /preview/ |
| Disallow | /5574* |
| Disallow | /xhr/ |
| Disallow | /*?redirectURL= |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /product/ |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cntraveller.com/sitemap.xml |
| sitemap | https://www.cntraveller.com/feed/google-latest-news/sitemap-google-news |
| sitemap | https://www.cntraveller.com/feed/rss |
| sitemap | https://www.cntraveller.com/branded-sitemap.xml |
| sitemap | https://www.cntraveller.com/contributors-sitemap.xml |
| sitemap | https://www.cntraveller.com/categories-sitemap.xml |
| sitemap | https://www.cntraveller.com/bundles-sitemap.xml |