car.gr
robots.txt
Robots Exclusion Standard data for car.gr
Resource Scan
Scan Details
| Site Domain | car.gr |
| Base Domain | car.gr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-02-25T00:30:44+00:00 |
| Next Scan | 2024-05-25T00:30:44+00:00 |
Last Successful Scan
| Scanned | 2023-10-28T18:47:50+00:00 |
| URL | https://car.gr/robots.txt |
| Redirect | https://www.car.gr/robots.txt |
| Redirect Domain | www.car.gr |
| Redirect Base | car.gr |
| Domain IPs | 104.22.10.170, 104.22.11.170, 172.67.8.64 |
| Redirect IPs | 104.22.10.170, 104.22.11.170, 172.67.8.64 |
| Response IP | 172.67.8.64 |
| Found | Yes |
| Hash | 920892d05440e6495b2a158efa347dcd1c9d22d9cfabb786cc9cb49ffe8e2f97 |
| SimHash | 4920d2d6c411 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /user/login/ |
| Disallow | /classified/login/ |
| Disallow | /account/ |
| Disallow | /api/ |
| Disallow | /too-many-classifieds/ |
| Disallow | /accounting/ |
| Disallow | /admin/ |
| Disallow | /parking/* |
| Disallow | /external/* |
| Disallow | /classifieds/compare* |
| Disallow | /external/* |
| Disallow | /*?*sort=pod* |
| Disallow | /*?*sort=mid* |
| Disallow | /*?*sort=cr* |
| Disallow | /*?*sort=red* |
| Disallow | /*?*sort=rea* |
| Disallow | /*?*kteo=* |
| Disallow | /parts/*?*sort=pra* |
| Disallow | /parts/*?*price=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.car.gr/sitemaps/sitemap_index.xml |