autopista.es
robots.txt
Robots Exclusion Standard data for autopista.es
Resource Scan
Scan Details
| Site Domain | autopista.es |
| Base Domain | autopista.es |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-26T22:37:16+00:00 |
| Next Scan | 2024-08-24T22:37:16+00:00 |
Last Successful Scan
| Scanned | 2023-08-01T22:31:15+00:00 |
| URL | https://autopista.es/robots.txt |
| Redirect | https://www.autopista.es/robots.txt |
| Redirect Domain | www.autopista.es |
| Redirect Base | autopista.es |
| Domain IPs | 49.12.113.234 |
| Redirect IPs | 138.199.44.209, 185.103.37.72, 51.195.63.237, 51.210.0.138, 51.89.172.162 |
| Response IP | 185.103.37.72 |
| Found | Yes |
| Hash | 1b6779261beaec35c6589cfadf46a23cf0440ee34922c2ab2f14cef3d7937ed4 |
| SimHash | 280c8f40c531 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /automercado/coches-segunda-mano-automercado-autopista |
| Disallow | /automercado/api |
| Disallow | /articulo.html* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.autopista.es/sitemap.xml |