autos.id
robots.txt
Robots Exclusion Standard data for autos.id
Resource Scan
Scan Details
| Site Domain | autos.id |
| Base Domain | autos.id |
| Scan Status | Ok |
| Last Scan | 2025-12-31T19:29:59+00:00 |
| Next Scan | 2026-01-07T19:29:59+00:00 |
Last Scan
| Scanned | 2025-12-31T19:29:59+00:00 |
| URL | https://autos.id/robots.txt |
| Domain IPs | 2a02:4780:15:11a5:b324:e29c:d165:d533, 2a02:4780:39:6b5d:7414:7be4:8d57:6396, 84.32.84.171, 84.32.84.215 |
| Response IP | 179.61.189.230 |
| Found | Yes |
| Hash | 1505c6e926efa4220f32b0a48ff4ed18a1b0a554c9f25867efe4a006e202c597 |
| SimHash | 58715c4625b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */?s |
| Disallow | *?ref= |
| Disallow | */feed |
| Disallow | /search/ |
| Disallow | */page/* |
| Disallow | /*?comments_popup= |
| Disallow | /author/*/page/ |
| Disallow | */attachment/* |
| Disallow | *?utm_source=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.autos.id/sitemap_index.xml |