bikedekho.com
robots.txt
Robots Exclusion Standard data for bikedekho.com
Resource Scan
Scan Details
| Site Domain | bikedekho.com |
| Base Domain | bikedekho.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-15T03:53:51+00:00 |
| Next Scan | 2024-06-29T03:53:51+00:00 |
Last Successful Scan
| Scanned | 2024-05-31T03:53:11+00:00 |
| URL | https://bikedekho.com/robots.txt |
| Redirect | https://www.bikedekho.com:443/robots.txt |
| Redirect Domain | www.bikedekho.com |
| Redirect Base | bikedekho.com |
| Domain IPs | 43.204.252.101, 65.0.226.114 |
| Redirect IPs | 2600:1413:b000:14::b857:c14a, 2600:1413:b000:14::b857:c151, 96.17.72.10, 96.17.72.80 |
| Response IP | 72.247.127.227 |
| Found | Yes |
| Hash | 8cd5f262bd6c090a925db9d50f1b8a224d7155ce4e0799e4d19b5de8d080713a |
| SimHash | 2a4282e44d91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /video/ |
| Disallow | /iframe/ |
| Disallow | /used-bikes-detail/0-* |
| Disallow | /validate-request |
| Disallow | /1089059/ |
| Disallow | /upload/360views/* |
| Disallow | /new-bike/update-filters/ |
| Disallow | /new-bike/update-filters?page=* |
| Disallow | /filter/* |
| Disallow | /crm/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bikedekho.com/sitemap.xml |
| sitemap | https://www.bikedekho.com/GoogleNewsSiteMap.xml |