aeaboutiquetravel.com
robots.txt
Robots Exclusion Standard data for aeaboutiquetravel.com
Resource Scan
Scan Details
Site Domain | aeaboutiquetravel.com |
Base Domain | aeaboutiquetravel.com |
Scan Status | Ok |
Last Scan | 2024-10-03T14:29:25+00:00 |
Next Scan | 2024-10-10T14:29:25+00:00 |
Last Scan
Scanned | 2024-10-03T14:29:25+00:00 |
URL | https://aeaboutiquetravel.com/robots.txt |
Redirect | https://www.aeaboutiquetravel.com/robots.txt |
Redirect Domain | www.aeaboutiquetravel.com |
Redirect Base | aeaboutiquetravel.com |
Domain IPs | 52.71.72.242 |
Redirect IPs | 13.248.160.16, 76.223.34.190 |
Response IP | 76.223.34.190 |
Found | Yes |
Hash | 0887cf6058f67ae56362b23dd61eb8e6abc4d4294a3790c6a3f3be5e0ac90ba9 |
SimHash | 2739da908c32 |
Groups
*
Rule | Path |
---|---|
Disallow | /i$ |
Disallow | /i/ |
Disallow | /smsRoutes/ |
Disallow | /sms/ |
Disallow | /extranet/ |
Disallow | /dashboard/ |
Disallow | /es/search |
Disallow | /es/multistays |
Disallow | /es/crossselling$ |
Disallow | /es/wishlist |
Disallow | /es/promo/*?* |
Disallow | /en/search |
Disallow | /en/multistays |
Disallow | /en/crossselling$ |
Disallow | /en/wishlist |
Disallow | /en/promo/*?* |
Disallow | /pt/search |
Disallow | /pt/multistays |
Disallow | /pt/crossselling$ |
Disallow | /pt/wishlist |
Disallow | /auth |
Disallow | /captcha.svg* |
Disallow | /mailcaptcha.svg* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.aeaboutiquetravel.com/sitemap.xml |
Warnings
- 1 invalid line.