autoblog.com
robots.txt
Robots Exclusion Standard data for autoblog.com
Resource Scan
Scan Details
| Site Domain | autoblog.com |
| Base Domain | autoblog.com |
| Scan Status | Ok |
| Last Scan | 2024-04-26T23:36:59+00:00 |
| Next Scan | 2024-05-03T23:36:59+00:00 |
Last Scan
| Scanned | 2024-04-26T23:36:59+00:00 |
| URL | https://autoblog.com/robots.txt |
| Redirect | https://www.autoblog.com/robots.txt |
| Redirect Domain | www.autoblog.com |
| Redirect Base | autoblog.com |
| Domain IPs | 13.248.158.7, 76.223.84.192 |
| Redirect IPs | 106.10.236.37, 106.10.236.40, 180.222.114.11, 180.222.114.12, 2406:2000:98:800::e5, 2406:2000:98:800::e6, 2406:2000:e4:1604::1000, 2406:2000:e4:1604::1001 |
| Response IP | 180.222.114.11 |
| Found | Yes |
| Hash | a81b8f6aacdd2157c49797cba50c6191561ef17c8083955961248d773900d5de |
| SimHash | 0f1d9a0149b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /forward |
| Disallow | /traffic |
| Disallow | /mm_track |
| Disallow | /search |
| Disallow | /*URL%* |
| Disallow | /used-api/ |
| Disallow | /used-insuranceads/ |
| Disallow | /getaquote/* |
| Disallow | /feed/* |
| Disallow | /api/* |
| Disallow | /buy/autoblog-bing-feed/* |
| Disallow | /cars-for-sale-detail* |
| Disallow | /autoblog-lrp-feed* |
| Disallow | /car-dealers/*/radius* |
| Disallow | /auto-repair-shops/*/radius* |
| Disallow | /*/sort-price/ |
| Allow | /api/sitemap/videos.xml |
| Allow | /api/sitemap/sitemap-videos_index.xml |
| Disallow | /ajax/* |
| Disallow | /car-questions/*/edit/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.autoblog.com/sitemap/sitemap_index.xml |
| sitemap | https://www.autoblog.com/api/sitemap/sitemap-videos_index.xml |
| sitemap | https://www.autoblog.com/cars-for-sale/sitemap_index.xml.gz |
| sitemap | https://www.autoblog.com/image-sitemap/sitemap-index.xml |
| sitemap | https://www.autoblog.com/google-news-feed48.xml |
| sitemap | https://www.autoblog.com/sitemap/commerce-sitemap.xml.gz |
| sitemap | https://www.autoblog.com/image-sitemap/ymmsitemap-index.xml |
| sitemap | https://www.autoblog.com/image-sitemap/makemodel-sitemap-index.xml |
| sitemap | https://www.autoblog.com/image-sitemap/car-values-sitemap-index.xml |