autozone.com.mx
robots.txt
Robots Exclusion Standard data for autozone.com.mx
Resource Scan
Scan Details
| Site Domain | autozone.com.mx |
| Base Domain | autozone.com.mx |
| Scan Status | Ok |
| Last Scan | 2024-10-18T10:29:05+00:00 |
| Next Scan | 2024-11-17T10:29:05+00:00 |
Last Scan
| Scanned | 2024-10-18T10:29:05+00:00 |
| URL | https://autozone.com.mx/robots.txt |
| Redirect | https://www.autozone.com.mx/robots.txt |
| Redirect Domain | www.autozone.com.mx |
| Redirect Base | autozone.com.mx |
| Domain IPs | 184.51.97.46 |
| Redirect IPs | 23.36.48.246 |
| Response IP | 23.54.56.166 |
| Found | Yes |
| Hash | bb5fadd62438b0955b91d151f2b2c5657144bce1e466b5457f25df770c4ab15d |
| SimHash | 68d69062e3a3 |
Groups
ahrefsbot
ahrefsbot/4.0
backlinkcrawler
gsitecrawler
ip-web-crawler.com
ips-agent
linkdex
linkdex.com
linkdex.com/v2.0
linkdex.com/v2.1
mj12bot
spyfu
xenu
xenu link sleuth
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
acoon
careerbot
findlinks/2.6
openwebindex/nutch-1.6
openwebindex
sistrixcrawler
sistrix
sistrix crawler
sistrix
| Rule | Path |
|---|---|
| Disallow | / |
baiduspider
baiduspider-video
baiduspider-image
baiduspider+
baiduspider+(+http://www.baidu.com/search/spider.htm)
baiduspider/2.0;+http://www.baidu.com/search/spider.html
baiduspider/2.0
mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
easouspider
jikespider
sosospider+
sosospider
sosospider/2.0
yisouspider
youdaobot/1.0
youdaobot/1.0
sogou spider
| Rule | Path |
|---|---|
| Disallow | / |
yandex
yandex/1.01.001
yandexbot/3.0-mirrordetector
yandeximages/3.0
yandexsomething/1.
yandex.com
yandexbot/3.0
aihitbot
aihitbot/1.0
aihitbot/1.1
mail.ru_bot/2.0
mail.ru
mail.ru
mail.ru_bot/2.0; +http://go.mail.ru/help/robots
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /atg/ |
| Disallow | /dyn/ |
| Disallow | /cart |
| Disallow | /rest/ |
| Disallow | /checkout |
| Disallow | /error/ |
| Disallow | /ymme/ |
| Disallow | /orderConfirmation |
| Disallow | */user/ |
| Disallow | *recsPerPage* |
| Disallow | */bn/ |
| Disallow | */bn$ |
| Disallow | */bn? |
| Disallow | */b/brand/*?facet= |
| Disallow | */under-2/ |
| Disallow | */no-rating/ |
| Disallow | */3-and-up/ |
| Disallow | */4-and-up/ |
| Disallow | */universal-products/b/ |
| Disallow | */vehiclespecific-products/b/ |
| Disallow | *?vehicleId= |
| Disallow | *%26vehicleId%3D |
| Disallow | *?filters= |
| Disallow | *%26filters%3D |
| Disallow | *?filterByKeyWord= |
| Disallow | *%26filterByKeyWord%3D |
| Disallow | *?rrec=true |
| Disallow | *%26rrec%3Dtrue |
| Disallow | */_/N- |
| Disallow | /errorPage |
| Disallow | /ecomm/b2c/order/v2/availability |
| Disallow | /ecomm/b2c/v1/store/preferredStore |
| Disallow | /ecomm/b2c/v2/page/header |
| Disallow | /ecomm/b2c/*/currentUser/ |
| Disallow | /expertips/wp-admin/ |
| Allow | /expertips/wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.autozone.com.mx/sitemap_index.xml |
| sitemap | https://www.autozone.com.mx/expertips/sitemap_index.xml |
Warnings
- 4 invalid lines.
Comments