dubaivansrental.com
robots.txt
Robots Exclusion Standard data for dubaivansrental.com
Resource Scan
Scan Details
| Site Domain | dubaivansrental.com |
| Base Domain | dubaivansrental.com |
| Scan Status | Ok |
| Last Scan | 2025-05-30T09:20:13+00:00 |
| Next Scan | 2025-06-06T09:20:13+00:00 |
Last Scan
| Scanned | 2025-05-30T09:20:13+00:00 |
| URL | https://dubaivansrental.com/robots.txt |
| Domain IPs | 20.69.69.104 |
| Response IP | 20.69.69.104 |
| Found | Yes |
| Hash | 75dd3702ca377db4f90a2a24b453e2ed4806dc9d7d0b77d38b8ffbfaaee3e9b4 |
| SimHash | 2f50de55a720 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /aboutus.html |
| Allow | /contactus.html |
| Allow | /faq.html |
| Allow | /car-rental-in-uae.html |
| Allow | /confirmation.html |
| Disallow | /admin/ |
| Disallow | /private/ |
| Disallow | /temp/ |
| Disallow | /backup/ |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /*.jpg$ |
| Allow | /*.jpeg$ |
| Allow | /*.png$ |
| Allow | /*.gif$ |
| Allow | /*.svg$ |
| Allow | /*.webp$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dubaivansrental.com/sitemap.xml |
Comments