autospot.ge
robots.txt
Robots Exclusion Standard data for autospot.ge
Resource Scan
Scan Details
Site Domain | autospot.ge |
Base Domain | autospot.ge |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-30T11:03:05+00:00 |
Next Scan | 2025-09-06T11:03:05+00:00 |
Last Successful Scan
Scanned | 2025-08-22T11:02:20+00:00 |
URL | https://autospot.ge/robots.txt |
Domain IPs | 2a02:4780:15:9867:1e09:456:65af:1b40, 2a02:4780:38:bbc1:20c3:b28f:1554:55a1, 84.32.84.246, 84.32.84.30 |
Response IP | 77.37.115.165 |
Found | Yes |
Hash | adb2a1fa82f1ae63914c3412235fa5d272ea11046eec0501cfae03c7d553b716 |
SimHash | 19061ce1b773 |
Groups
*
Rule | Path |
---|---|
Disallow | /media/ |
Disallow | /temp/ |
Disallow | /eng/user/ |
Disallow | /geo/user/ |
Disallow | /rus/user/ |
Disallow | /hy/user/ |
Disallow | /kk/user/ |
Disallow | /uk/user/ |
Disallow | /tr/user/ |
Disallow | /uz/user/ |
Disallow | /az/user/ |
Disallow | /ky/user/ |
Disallow | /templates/ |
Disallow | /systems/ajax/cart.php |
Disallow | /systems/ajax/chat.php |
Allow | /media/images_boards/small |
Allow | /media/images_boards/big |
Other Records
Field | Value |
---|---|
sitemap | https://autospot.ge/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.