budget.es
robots.txt
Robots Exclusion Standard data for budget.es
Resource Scan
Scan Details
Site Domain | budget.es |
Base Domain | budget.es |
Scan Status | Ok |
Last Scan | 2024-11-11T22:21:16+00:00 |
Next Scan | 2024-12-11T22:21:16+00:00 |
Last Scan
Scanned | 2024-11-11T22:21:16+00:00 |
URL | https://budget.es/robots.txt |
Redirect | https://www.budget.es/robots.txt |
Redirect Domain | www.budget.es |
Redirect Base | budget.es |
Domain IPs | 44.206.13.149, 52.200.95.119 |
Redirect IPs | 108.156.133.101, 108.156.133.2, 108.156.133.72, 108.156.133.79 |
Response IP | 108.156.133.72 |
Found | Yes |
Hash | f60ffbc70eecd15a58e19c96307aabab327ece7e06db3e4ea79dbd1e1da65c3b |
SimHash | 7d051458c710 |
Groups
*
Rule | Path |
---|---|
Disallow | /budget-ES* |
Disallow | /budget-UK* |
Disallow | /budget-DE* |
Disallow | /budget-IT* |
Disallow | /budget-FR* |
Disallow | /Expired-Offers* |
Disallow | /NOT-VALID-extras-budget* |
Disallow | /-----ARCHIVE-------OLD-OFFERS* |
Disallow | /emailTemplates* |
Disallow | /errorPages* |
Disallow | /budgetonline* |
Disallow | /rental-locations/barcelona.h |
Other Records
Field | Value |
---|---|
sitemap | https://www.budget.es/sitemap.xml |
Warnings
- `noindex` is not a known field.