carnext.com
robots.txt
Robots Exclusion Standard data for carnext.com
Resource Scan
Scan Details
| Site Domain | carnext.com |
| Base Domain | carnext.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-13T13:36:00+00:00 |
| Next Scan | 2024-07-12T13:36:00+00:00 |
Last Successful Scan
| Scanned | 2024-02-21T13:34:13+00:00 |
| URL | https://www.carnext.com/robots.txt |
| Domain IPs | 13.226.2.38, 13.226.2.39, 13.226.2.41, 13.226.2.89, 2600:9000:21f8:1c00:14:c615:4280:93a1, 2600:9000:21f8:7800:14:c615:4280:93a1, 2600:9000:21f8:8c00:14:c615:4280:93a1, 2600:9000:21f8:9a00:14:c615:4280:93a1, 2600:9000:21f8:a600:14:c615:4280:93a1, 2600:9000:21f8:d000:14:c615:4280:93a1, 2600:9000:21f8:e000:14:c615:4280:93a1, 2600:9000:21f8:ee00:14:c615:4280:93a1 |
| Response IP | 18.165.171.36 |
| Found | Yes |
| Hash | 2787e399f03b6ceb0baa0dcd16ed14f62cc961286fb0a2d525f5feb315577074 |
| SimHash | b050d06da87a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */checkout/* |
| Disallow | */fr-fr/chercher/* |
| Disallow | */de-de/suche/* |
| Disallow | */en-de/search/* |
| Disallow | */it-it/ricerca/* |
| Disallow | */nl-nl/zoek/* |
| Disallow | */nb-no/sok/* |
| Disallow | */pt-pt/encontre/* |
| Disallow | */es-es/buscar/* |
| Disallow | */nb-no/biler2/* |
| Disallow | */fr-fr/voitures2/* |
| Disallow | */de-de/autos2/* |
| Disallow | */en-de/cars2/* |
| Disallow | */it-it/occasioni-e-offerte2/* |
| Disallow | */nl-nl/autos2/* |
| Disallow | */pt-pt/carros2/* |
| Disallow | */es-es/coches2/* |
| Disallow | */redirect/id/* |
| Disallow | */redirect/hexon/* |
| Disallow | */redirect/cid/* |