dubicars.com
robots.txt
Robots Exclusion Standard data for dubicars.com
Resource Scan
Scan Details
| Site Domain | dubicars.com |
| Base Domain | dubicars.com |
| Scan Status | Ok |
| Last Scan | 2024-09-27T05:02:43+00:00 |
| Next Scan | 2024-10-04T05:02:43+00:00 |
Last Scan
| Scanned | 2024-09-27T05:02:43+00:00 |
| URL | https://dubicars.com/robots.txt |
| Redirect | https://www.dubicars.com/robots.txt |
| Redirect Domain | www.dubicars.com |
| Redirect Base | dubicars.com |
| Domain IPs | 18.139.200.69, 18.141.49.94, 52.220.144.221 |
| Redirect IPs | 104.22.72.188, 104.22.73.188, 172.67.11.73, 2606:4700:10::6816:48bc, 2606:4700:10::6816:49bc, 2606:4700:10::ac43:b49 |
| Response IP | 104.22.73.188 |
| Found | Yes |
| Hash | c51091c82108082db9306acc23962835e7d3407b9c8a224fd017959809be3217 |
| SimHash | b9785b4468d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /old-home |
| Disallow | /rr |
| Disallow | /api |
| Disallow | /ar/api |
| Disallow | /ajax |
| Disallow | /ar/ajax |
| Disallow | /webapp |
| Disallow | /search |
| Disallow | /search-count |
| Disallow | /ping-sc |
| Disallow | /ar/webapp |
| Disallow | /ar/search |
| Disallow | /mandrill |
| Disallow | /ar/mandrill |
| Disallow | /sell-your-car/create-ad/ |
| Disallow | /ar/sell-your-car/create-ad/ |
| Disallow | /*?*dealerlayout* |
| Disallow | /*?*__hsfp* |
| Disallow | /printable-flyer |
| Disallow | /ar/printable-flyer |
| Disallow | /uae-car-insurance-quotes |
| Disallow | /ar/uae-car-insurance-quotes |
| Disallow | *?o= |
| Disallow | *?gclid= |
| Disallow | *?view= |
| Disallow | *?cr= |
| Disallow | *?c=used |
| Disallow | *?c=new |
| Disallow | *?ma=* |
| Disallow | *?l=* |
| Disallow | *?last_listing_type= |
| Disallow | /export-safe-intro |
| Disallow | /export-faqs |
| Disallow | /copyright-for-app |
| Disallow | /new-cars/compare/comparison |
| Disallow | /ar/new-cars/compare/comparison |
| Disallow | */export/fpa* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dubicars.com/sitemap.xml |
Comments