budget.es
robots.txt

Robots Exclusion Standard data for budget.es

Resource Scan

Scan Details

Site Domain budget.es
Base Domain budget.es
Scan Status Ok
Last Scan2024-09-12T20:16:32+00:00
Next Scan 2024-10-12T20:16:32+00:00

Last Scan

Scanned2024-09-12T20:16:32+00:00
URL https://budget.es/robots.txt
Redirect https://www.budget.es/robots.txt
Redirect Domain www.budget.es
Redirect Base budget.es
Domain IPs 44.206.13.149, 52.200.95.119
Redirect IPs 108.156.133.101, 108.156.133.2, 108.156.133.72, 108.156.133.79
Response IP 108.156.133.79
Found Yes
Hash f60ffbc70eecd15a58e19c96307aabab327ece7e06db3e4ea79dbd1e1da65c3b
SimHash 7d051458c710

Groups

*

Rule Path
Disallow /budget-ES*
Disallow /budget-UK*
Disallow /budget-DE*
Disallow /budget-IT*
Disallow /budget-FR*
Disallow /Expired-Offers*
Disallow /NOT-VALID-extras-budget*
Disallow /-----ARCHIVE-------OLD-OFFERS*
Disallow /emailTemplates*
Disallow /errorPages*
Disallow /budgetonline*
Disallow /rental-locations/barcelona.h

Other Records

Field Value
sitemap https://www.budget.es/sitemap.xml

Warnings

  • `noindex` is not a known field.