smartcarguide.com
robots.txt
Robots Exclusion Standard data for smartcarguide.com
Resource Scan
Scan Details
| Site Domain | smartcarguide.com |
| Base Domain | smartcarguide.com |
| Scan Status | Ok |
| Last Scan | 2024-06-26T14:10:04+00:00 |
| Next Scan | 2024-07-03T14:10:04+00:00 |
Last Scan
| Scanned | 2024-06-26T14:10:04+00:00 |
| URL | https://smartcarguide.com/robots.txt |
| Domain IPs | 104.21.55.163, 172.67.149.51, 2606:4700:3031::6815:37a3, 2606:4700:3035::ac43:9533 |
| Response IP | 104.21.55.163 |
| Found | Yes |
| Hash | 74d9b8799e6d1f2fc3e5f5b1c93350914ef5ac5950e5de08e394f1c98d716a10 |
| SimHash | d81ecac9d550 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /cars/ |
| Disallow | /motorcycles/ |
| Disallow | /vehicles/ |
| Disallow | /parts/ |
| Disallow | /for-sale/ |
| Disallow | /listing/ |
| Disallow | /listing-dt/ |
| Disallow | /pictures- |
| Disallow | /p- |
| Disallow | /radius- |
| Disallow | /components/tools/ |
| Disallow | /gui/ |
| Disallow | /*/p- |
| Disallow | /*/radius- |
| Disallow | /*/pictures-yes |
| Disallow | /*/pictures-no |
| Disallow | /*/s-dateasc |
| Disallow | /*/s-date |
| Disallow | /*/s-price |
| Disallow | /*/s-priceasc |
Warnings
- `noindex` is not a known field.
Comments