traveler.es
robots.txt
Robots Exclusion Standard data for traveler.es
Resource Scan
Scan Details
| Site Domain | traveler.es |
| Base Domain | traveler.es |
| Scan Status | Ok |
| Last Scan | 2024-09-14T00:37:18+00:00 |
| Next Scan | 2024-09-21T00:37:18+00:00 |
Last Scan
| Scanned | 2024-09-14T00:37:18+00:00 |
| URL | https://traveler.es/robots.txt |
| Redirect | https://www.traveler.es/robots.txt |
| Redirect Domain | www.traveler.es |
| Redirect Base | traveler.es |
| Domain IPs | 151.101.0.239, 151.101.128.239, 151.101.192.239, 151.101.64.239 |
| Redirect IPs | 13.35.238.107, 13.35.238.17, 13.35.238.64, 13.35.238.78, 2600:9000:2085:2600:12:9a37:52c0:93a1, 2600:9000:2085:2c00:12:9a37:52c0:93a1, 2600:9000:2085:4000:12:9a37:52c0:93a1, 2600:9000:2085:6400:12:9a37:52c0:93a1, 2600:9000:2085:9a00:12:9a37:52c0:93a1, 2600:9000:2085:aa00:12:9a37:52c0:93a1, 2600:9000:2085:b200:12:9a37:52c0:93a1, 2600:9000:2085:e000:12:9a37:52c0:93a1 |
| Response IP | 13.35.238.78 |
| Found | Yes |
| Hash | af54267b5d618e39be625de7a3b1e4200e46a4e86966eb77e2f26a793f53e3b2 |
| SimHash | 459cc941c650 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /preview/ |
| Disallow | /*/galerias/*/*/image/ |
| Disallow | /*?image= |
| Disallow | */image/ |
| Disallow | /*?redirectURL= |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /product/ |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.traveler.es/sitemap.xml |
| sitemap | https://www.traveler.es/feed/google-latest-news/sitemap-google-news |
| sitemap | https://www.traveler.es/feed/rss |
| sitemap | https://www.traveler.es/categories-sitemap.xml |
| sitemap | https://www.traveler.es/contributors-sitemap.xml |
| sitemap | https://www.traveler.es/bundles-sitemap.xml |