automarket.ro
robots.txt
Robots Exclusion Standard data for automarket.ro
Resource Scan
Scan Details
Site Domain | automarket.ro |
Base Domain | automarket.ro |
Scan Status | Ok |
Last Scan | 2024-11-04T14:25:39+00:00 |
Next Scan | 2024-11-11T14:25:39+00:00 |
Last Scan
Scanned | 2024-11-04T14:25:39+00:00 |
URL | https://automarket.ro/robots.txt |
Domain IPs | 31.14.18.59, 31.14.18.60 |
Response IP | 31.14.18.60 |
Found | Yes |
Hash | fbde4c151dd299a006d2145baa09da68e080be0c9ad26df22c5b614659f5e1fb |
SimHash | 99a568b46b93 |
Groups
*
Rule | Path |
---|---|
Disallow | /include/ |
Disallow | /img/ |
Disallow | /admin/ |
Disallow | /ajax/ |
Disallow | /account/ |
Disallow | /dealer_direct/ |
Disallow | /configurator/ajax/ |
Disallow | /configurator/masini/ |
Disallow | /configurator/version/comparedetails/ |
Disallow | /adrese-utile/img/ |
Disallow | /utils/ |
Disallow | /anvelope/carfilter/homepageselector/ |