traveler.es
robots.txt
Robots Exclusion Standard data for traveler.es
Resource Scan
Scan Details
| Site Domain | traveler.es |
| Base Domain | traveler.es |
| Scan Status | Ok |
| Last Scan | 2024-06-29T00:35:09+00:00 |
| Next Scan | 2024-07-06T00:35:09+00:00 |
Last Scan
| Scanned | 2024-06-29T00:35:09+00:00 |
| URL | https://traveler.es/robots.txt |
| Redirect | https://www.traveler.es/robots.txt |
| Redirect Domain | www.traveler.es |
| Redirect Base | traveler.es |
| Domain IPs | 151.101.0.239, 151.101.128.239, 151.101.192.239, 151.101.64.239 |
| Redirect IPs | 2600:9000:271a:1400:12:9a37:52c0:93a1, 2600:9000:271a:3600:12:9a37:52c0:93a1, 2600:9000:271a:4400:12:9a37:52c0:93a1, 2600:9000:271a:4a00:12:9a37:52c0:93a1, 2600:9000:271a:5000:12:9a37:52c0:93a1, 2600:9000:271a:7600:12:9a37:52c0:93a1, 2600:9000:271a:ca00:12:9a37:52c0:93a1, 2600:9000:271a:f800:12:9a37:52c0:93a1, 3.165.82.10, 3.165.82.107, 3.165.82.80, 3.165.82.84 |
| Response IP | 3.165.82.84 |
| Found | Yes |
| Hash | 414eccc3662f2264321969fb328cd3e8638159c85e78e677187828c1fa07f153 |
| SimHash | 4594c961c611 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /preview/ |
| Disallow | /*/galerias/*/*/image/ |
| Disallow | /*?image= |
| Disallow | */image/ |
| Disallow | /*?redirectURL= |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /*%7B%7Burl%7D%7D |
| Disallow | /auth/* |
| Disallow | /account/* |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /*%7B%7Bsection%7D%7D |
| Disallow | /product/ |
| Disallow | /user-context?referrer |
| Disallow | /services.min.js?_= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.traveler.es/sitemap.xml |
| sitemap | https://www.traveler.es/feed/google-latest-news/sitemap-google-news |
| sitemap | https://www.traveler.es/feed/rss |
| sitemap | https://www.traveler.es/categories-sitemap.xml |
| sitemap | https://www.traveler.es/contributors-sitemap.xml |
| sitemap | https://www.traveler.es/bundles-sitemap.xml |