dubicars.com
robots.txt
Robots Exclusion Standard data for dubicars.com
Resource Scan
Scan Details
| Site Domain | dubicars.com |
| Base Domain | dubicars.com |
| Scan Status | Ok |
| Last Scan | 2024-06-13T19:23:29+00:00 |
| Next Scan | 2024-06-20T19:23:29+00:00 |
Last Scan
| Scanned | 2024-06-13T19:23:29+00:00 |
| URL | https://dubicars.com/robots.txt |
| Redirect | https://www.dubicars.com/robots.txt |
| Redirect Domain | www.dubicars.com |
| Redirect Base | dubicars.com |
| Domain IPs | 13.213.217.100, 18.138.18.236, 52.220.244.49 |
| Redirect IPs | 104.22.8.131, 104.22.9.131, 172.67.20.167, 2606:4700:10::6816:883, 2606:4700:10::6816:983, 2606:4700:10::ac43:14a7 |
| Response IP | 104.22.8.131 |
| Found | Yes |
| Hash | 8ebd84729047dc4e6e15957e5551c4396359fcc51d6b7c32ac81efc77b76f953 |
| SimHash | b9785b4068d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /old-home |
| Disallow | /rr |
| Disallow | /api |
| Disallow | /ar/api |
| Disallow | /ajax |
| Disallow | /ar/ajax |
| Disallow | /webapp |
| Disallow | /search |
| Disallow | /search-count |
| Disallow | /ping-sc |
| Disallow | /ar/webapp |
| Disallow | /ar/search |
| Disallow | /mandrill |
| Disallow | /ar/mandrill |
| Disallow | /sell-your-car/create-ad/ |
| Disallow | /ar/sell-your-car/create-ad/ |
| Disallow | /*?*dealerlayout* |
| Disallow | /*?*__hsfp* |
| Disallow | /printable-flyer |
| Disallow | /ar/printable-flyer |
| Disallow | /uae-car-insurance-quotes |
| Disallow | /ar/uae-car-insurance-quotes |
| Disallow | *?o= |
| Disallow | *?gclid= |
| Disallow | *?view= |
| Disallow | *?cr= |
| Disallow | *?c=used |
| Disallow | *?c=new |
| Disallow | *?ma=* |
| Disallow | *?l=* |
| Disallow | *?last_listing_type= |
| Disallow | /export-safe-intro |
| Disallow | /export-faqs |
| Disallow | /copyright-for-app |
| Disallow | /new-cars/compare/comparison |
| Disallow | /ar/new-cars/compare/comparison |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dubicars.com/sitemap.xml |
Comments