webike.mx
robots.txt
Robots Exclusion Standard data for webike.mx
Resource Scan
Scan Details
| Site Domain | webike.mx |
| Base Domain | webike.mx |
| Scan Status | Ok |
| Last Scan | 2025-11-20T00:16:02+00:00 |
| Next Scan | 2025-11-27T00:16:02+00:00 |
Last Scan
| Scanned | 2025-11-20T00:16:02+00:00 |
| URL | https://www.webike.mx/robots.txt |
| Domain IPs | 59.106.231.201 |
| Response IP | 59.106.231.201 |
| Found | Yes |
| Hash | 755643a7437402428702ee353ca277f8146a1559497cf326cd894d8636c63199 |
| SimHash | 4300ddf0eb31 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bm/prv/ |
| Disallow | /brd/prv/ |
| Disallow | */mprv/$ |
| Disallow | /payment-confirm.html |
| Disallow | /shopping_cart.html |
| Disallow | /login.html |
| Disallow | /product-reviews-write/ |
| Disallow | /contact_us |
facebookexternalhit/1.1
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
meta-externalagent/1.1
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /index.php?main_page=cookie_usage |