cafeytren.com
robots.txt
Robots Exclusion Standard data for cafeytren.com
Resource Scan
Scan Details
Site Domain | cafeytren.com |
Base Domain | cafeytren.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-05-12T09:08:46+00:00 |
Next Scan | 2025-06-11T09:08:46+00:00 |
Last Successful Scan
Scanned | 2025-04-13T09:03:25+00:00 |
URL | https://cafeytren.com/robots.txt |
Redirect | http://www.cafeytren.com/robots.txt |
Redirect Domain | www.cafeytren.com |
Redirect Base | cafeytren.com |
Domain IPs | 66.225.221.181 |
Redirect IPs | 66.225.221.181 |
Response IP | 66.225.221.181 |
Found | Yes |
Hash | ff817b05eb13f3467494acc8f8154d987a2a92d39f7cdd92ba03438080488e74 |
SimHash | a05a5993c6f7 |
Groups
*
Rule | Path |
---|---|
Disallow | /ir/ |
Disallow | /alojamiento/hostales/ |
Disallow | /alojamiento/europa/ |
Disallow | /vuelos-baratos/ |
Disallow | /aeropuertos/ |
Disallow | /albumfotos/ |
Disallow | /hoteles-playa/ |