autozone.com
robots.txt
Robots Exclusion Standard data for autozone.com
Resource Scan
Scan Details
| Site Domain | autozone.com |
| Base Domain | autozone.com |
| Scan Status | Ok |
| Last Scan | 2024-09-15T22:13:58+00:00 |
| Next Scan | 2024-09-22T22:13:58+00:00 |
Last Scan
| Scanned | 2024-09-15T22:13:58+00:00 |
| URL | https://autozone.com/robots.txt |
| Redirect | https://www.autozone.com/robots.txt |
| Redirect Domain | www.autozone.com |
| Redirect Base | autozone.com |
| Domain IPs | 23.36.48.246 |
| Redirect IPs | 23.36.48.246 |
| Response IP | 23.54.56.166 |
| Found | Yes |
| Hash | 0787f0e0f756aee6238c05def8806f53126daba2312953c1ca9d5f4a45841458 |
| SimHash | 60d69062efa3 |
Groups
ahrefsbot
ahrefsbot/4.0
backlinkcrawler
gsitecrawler
ip-web-crawler.com
ips-agent
linkdex
linkdex.com
linkdex.com/v2.0
linkdex.com/v2.1
mj12bot
spyfu
xenu
xenu link sleuth
dotbot
| Rule | Path |
|---|---|
| Disallow | / |
acoon
careerbot
findlinks/2.6
openwebindex/nutch-1.6
openwebindex
sistrixcrawler
sistrix
sistrix crawler
sistrix
| Rule | Path |
|---|---|
| Disallow | / |
baiduspider
baiduspider-video
baiduspider-image
baiduspider+
baiduspider+(+http://www.baidu.com/search/spider.htm)
baiduspider/2.0;+http://www.baidu.com/search/spider.html
baiduspider/2.0
mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
easouspider
jikespider
sosospider+
sosospider
sosospider/2.0
yisouspider
youdaobot/1.0
youdaobot/1.0
sogou spider
| Rule | Path |
|---|---|
| Disallow | / |
yandex
yandex/1.01.001
yandexbot/3.0-mirrordetector
yandeximages/3.0
yandexsomething/1.
yandex.com
yandexbot/3.0
aihitbot
aihitbot/1.0
aihitbot/1.1
mail.ru_bot/2.0
mail.ru
mail.ru
mail.ru_bot/2.0; +http://go.mail.ru/help/robots
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /atg/ |
| Disallow | /dyn/ |
| Disallow | /cart |
| Disallow | /rest/ |
| Disallow | /checkout |
| Disallow | /error/ |
| Disallow | /ymme/ |
| Disallow | /orderConfirmation |
| Disallow | */user/ |
| Disallow | *recsPerPage* |
| Disallow | */bn/ |
| Disallow | */bn$ |
| Disallow | */bn? |
| Disallow | */under-2/ |
| Disallow | */no-rating/ |
| Disallow | */3-and-up/ |
| Disallow | */4-and-up/ |
| Disallow | */universal-products/b/ |
| Disallow | */vehiclespecific-products/b/ |
| Disallow | *?vehicleId= |
| Disallow | *%26vehicleId%3D |
| Disallow | *?filters= |
| Disallow | *%26filters%3D |
| Disallow | *?filterByKeyWord= |
| Disallow | *%26filterByKeyWord%3D |
| Disallow | *?rrec=true |
| Disallow | *%26rrec%3Dtrue |
| Disallow | */_/N- |
| Disallow | */US_CENSUS_NAME |
| Disallow | *%7BUS_CENSUS_NAME |
| Disallow | /myzone/profile/login.jsp?redirectURL= |
| Disallow | /signin* |
| Allow | /signin$ |
| Disallow | /TealeafTarget |
| Disallow | /errorPage |
| Disallow | /ecomm/b2c/order/v2/availability |
| Disallow | /ecomm/b2c/v1/store/preferredStore |
| Disallow | /ecomm/b2c/v2/page/header |
| Disallow | /ecomm/b2c/*/currentUser/ |
| Disallow | /diy/wp-admin/ |
| Disallow | */b/brand/*?facet= |
| Disallow | /locations/es/ |
| Disallow | /locations/us/ |
| Disallow | *?bvstate=pg |
| Disallow | *?searchText= |
| Disallow | */diy/?s= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.autozone.com/sitemap_index.xml |
| sitemap | https://www.autozone.com/diy/sitemap_index.xml |
| sitemap | https://www.autozone.com/locations/sitemap.xml |
Warnings
- 4 invalid lines.
Comments