drive.yango.com
robots.txt
Robots Exclusion Standard data for drive.yango.com
Resource Scan
Scan Details
| Site Domain | drive.yango.com |
| Base Domain | yango.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T10:59:41+00:00 |
| Next Scan | 2024-12-03T10:59:41+00:00 |
Last Scan
| Scanned | 2024-11-03T10:59:41+00:00 |
| URL | https://drive.yango.com/robots.txt |
| Domain IPs | 13.33.88.68, 13.33.88.81, 13.33.88.84, 13.33.88.90, 2600:9000:223b:1c00:2:2120:14c0:93a1, 2600:9000:223b:2000:2:2120:14c0:93a1, 2600:9000:223b:4a00:2:2120:14c0:93a1, 2600:9000:223b:5400:2:2120:14c0:93a1, 2600:9000:223b:6000:2:2120:14c0:93a1, 2600:9000:223b:600:2:2120:14c0:93a1, 2600:9000:223b:dc00:2:2120:14c0:93a1, 2600:9000:223b:ea00:2:2120:14c0:93a1 |
| Response IP | 13.33.88.81 |
| Found | Yes |
| Hash | 72ed6654cbeb7a25d4474f0731c9d613cd77c76f3c0bed98bee97e54b5427604 |
| SimHash | 61098e47e3b7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /rent-cars-dubai |
| Allow | /locations |
| Allow | /quick-links |
| Allow | /cars-by-brands |
| Allow | /cars-by-classes |
| Disallow | /search |
| Disallow | /car |
| Disallow | /cars |
| Disallow | /book |
| Disallow | /book-quick |
| Disallow | /updated |
| Disallow | /index-old |
| Disallow | /offer |
| Disallow | /account |
| Disallow | /api/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://drive.yango.com/sitemap.xml |
Warnings
- `host` is not a known field.