todopisos.es
robots.txt
Robots Exclusion Standard data for todopisos.es
Resource Scan
Scan Details
Site Domain | todopisos.es |
Base Domain | todopisos.es |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-21T02:56:01+00:00 |
Next Scan | 2024-12-20T02:56:01+00:00 |
Last Successful Scan
Scanned | 2024-08-22T21:25:31+00:00 |
URL | https://todopisos.es/robots.txt |
Redirect | https://www.todopisos.es/robots.txt |
Redirect Domain | www.todopisos.es |
Redirect Base | todopisos.es |
Domain IPs | 5.135.40.62 |
Redirect IPs | 5.135.40.62 |
Response IP | 5.135.40.62 |
Found | Yes |
Hash | daccc9dcbbe6879437b6fc188262fa8cd0336f144a0a74bacc7069de390bf14c |
SimHash | d01e5362c621 |
Groups
*
Rule | Path |
---|---|
Allow | /*.css* |
Allow | /*.png* |
Allow | /*.jpg* |
Allow | /*.gif* |
Disallow | /administrator/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /layouts/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /tmp/ |
Disallow | /*? |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |