carandbike.com
robots.txt
Robots Exclusion Standard data for carandbike.com
Resource Scan
Scan Details
| Site Domain | carandbike.com |
| Base Domain | carandbike.com |
| Scan Status | Ok |
| Last Scan | 2024-05-30T19:10:26+00:00 |
| Next Scan | 2024-06-06T19:10:26+00:00 |
Last Scan
| Scanned | 2024-05-30T19:10:26+00:00 |
| URL | https://carandbike.com/robots.txt |
| Redirect | https://www.carandbike.com/robots.txt |
| Redirect Domain | www.carandbike.com |
| Redirect Base | carandbike.com |
| Domain IPs | 18.155.68.115, 18.155.68.17, 18.155.68.46, 18.155.68.85 |
| Redirect IPs | 2600:9000:2003:1200:17:d415:fd00:93a1, 2600:9000:2003:1600:17:d415:fd00:93a1, 2600:9000:2003:6800:17:d415:fd00:93a1, 2600:9000:2003:7200:17:d415:fd00:93a1, 2600:9000:2003:c400:17:d415:fd00:93a1, 2600:9000:2003:d800:17:d415:fd00:93a1, 2600:9000:2003:e00:17:d415:fd00:93a1, 2600:9000:2003:ee00:17:d415:fd00:93a1, 52.84.229.100, 52.84.229.18, 52.84.229.48, 52.84.229.76 |
| Response IP | 52.84.229.76 |
| Found | Yes |
| Hash | 3c7d0c47ae5262b2ff7d30fc963f7fde3a1e05c98d85077f8c66d716d5439735 |
| SimHash | d9242cf5c117 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /want-cars/ |
| Disallow | /admin/ |
| Disallow | /newcar/ |
| Disallow | /newbike/ |
| Disallow | /classifieds/ |
| Disallow | /bike-classifieds/ |
| Disallow | /evaluation/ |
| Disallow | /ndtv/ |
| Disallow | /vehicle/ |
| Disallow | *?variant1= |
| Disallow | *?variant2= |
| Disallow | *?id3= |
| Disallow | *?q= |
| Disallow | *?model= |
| Disallow | *?tvc_universalCookie= |
| Disallow | *?model3= |
| Disallow | *?listing= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.carandbike.com/sitemap.xml |
| sitemap | https://www.carandbike.com/news/sitemap.xml |