autox.com
robots.txt
Robots Exclusion Standard data for autox.com
Resource Scan
Scan Details
Site Domain | autox.com |
Base Domain | autox.com |
Scan Status | Ok |
Last Scan | 2024-11-01T15:40:17+00:00 |
Next Scan | 2024-11-08T15:40:17+00:00 |
Last Scan
Scanned | 2024-11-01T15:40:17+00:00 |
URL | https://autox.com/robots.txt |
Redirect | https://www.autox.com/robots.txt |
Redirect Domain | www.autox.com |
Redirect Base | autox.com |
Domain IPs | 13.234.157.62 |
Redirect IPs | 13.234.157.62 |
Response IP | 13.234.157.62 |
Found | Yes |
Hash | 5f71dc7848d525ce28eeddea9b674519e3f8fe6dcd367d3d641041eae85b88ae |
SimHash | cd579d426052 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /api/ |
Disallow | /apicars24/ |
Disallow | /uploads/ |
Disallow | /cars24/ |
Disallow | /user/ |
Disallow | /Comment/ |
Disallow | /uploads/cars/brochure/ |
Disallow | /uploads/bikes/brochure/ |
Disallow | /new-cars/electric-cars/ |
Disallow | /electric-cars/%28%3Aany%29/ |
Disallow | /electric-cars/%28%3Aany%29/%28%3Aany%29/ |
Disallow | /faqs/ |
Disallow | /faqs/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.autox.com/sitemap.xml |
sitemap | https://www.autox.com/google-news-sitemap.xml |