amazon.com
robots.txt

Robots Exclusion Standard data for amazon.com

Resource Scan

Scan Details

Site Domain amazon.com
Base Domain amazon.com
Scan Status Ok
Last Scan2024-11-12T22:16:24+00:00
Next Scan 2024-11-19T22:16:24+00:00

Last Scan

Scanned2024-11-12T22:16:24+00:00
URL https://amazon.com/robots.txt
Redirect https://www.amazon.com/robots.txt
Redirect Domain www.amazon.com
Redirect Base amazon.com
Domain IPs 205.251.242.103, 52.94.236.248, 54.239.28.85
Redirect IPs 13.33.180.236, 2600:9000:2816:2c00:7:49a5:5fd4:b121, 2600:9000:2816:4400:7:49a5:5fd4:b121, 2600:9000:2816:4e00:7:49a5:5fd4:b121, 2600:9000:2816:6200:7:49a5:5fd4:b121, 2600:9000:2816:7a00:7:49a5:5fd4:b121, 2600:9000:2816:ba00:7:49a5:5fd4:b121, 2600:9000:2816:ca00:7:49a5:5fd4:b121, 2600:9000:2816:d200:7:49a5:5fd4:b121
Response IP 3.165.85.38
Found Yes
Hash a111099ba49c980bb7c08034b3da8bddfc055cf2878d92881a991b1d7b7f22bb
SimHash 40ab8e9ba1bf

Groups

*

Rule Path
Disallow /exec/obidos/account-access-login
Disallow /exec/obidos/change-style
Disallow /exec/obidos/flex-sign-in
Disallow /exec/obidos/handle-buy-box
Disallow /exec/obidos/tg/cm/member/
Disallow /gp/aw/help/id%3Dsss
Disallow /gp/cart
Disallow /gp/flex
Disallow /gp/product/e-mail-friend
Disallow /gp/product/product-availability
Disallow /gp/product/rate-this-item
Disallow /gp/sign-in
Disallow /gp/reader
Disallow /gp/sitbv3/reader
Disallow /gp/richpub/syltguides/create
Disallow /gp/gfix
Disallow /gp/associations/wizard.html
Disallow /gp/dmusic/order
Disallow /gp/legacy-handle-buy-box.html
Disallow /gp/aws/ssop
Disallow /gp/yourstore
Disallow /gp/gift-central/organizer/add-wishlist
Disallow /gp/vote
Disallow /gp/voting/
Disallow /gp/music/wma-pop-up
Disallow /gp/customer-images
Disallow /gp/richpub/listmania/createpipeline
Disallow /gp/content-form
Disallow /gp/pdp/invitation/invite
Disallow /gp/customer-reviews/common/du
Disallow /gp/customer-reviews/write-a-review.html
Disallow /gp/associations/wizard.html
Disallow /gp/music/clipserve
Disallow /gp/customer-media/upload
Disallow /gp/history
Disallow /gp/item-dispatch
Disallow /gp/dmusic/order/handle-buy-box.html
Disallow /gp/recsradio
Disallow /gp/slredirect
Disallow /dp/shipping/
Disallow /dp/twister-update/
Disallow /dp/manual-submit/
Disallow /dp/e-mail-friend/
Disallow /dp/product-availability/
Disallow /dp/rate-this-item/
Disallow /gp/registry/wishlist/*/reserve
Disallow /gp/structured-ratings/actions/get-experience.html
Disallow /gp/twitter/
Disallow /ap/signin
Disallow /gp/registry/wishlist/
Disallow /wishlist/
Allow /wishlist/universal*
Allow /wishlist/vendor-button*
Allow /wishlist/get-button*
Disallow /gp/wishlist/
Allow /gp/wishlist/universal*
Allow /gp/wishlist/vendor-button*
Allow /gp/wishlist/ipad-install*
Disallow /registry/wishlist/
Disallow /review/common/du
Disallow /gp/registry/search.html
Disallow /product-reviews/B0069IY63Y
Disallow /gp/orc/rml/
Disallow */gcrnsts
Disallow /gp/gc/widget
Disallow /gp/dmusic/mp3/player
Disallow /gp/entity-alert/external
Disallow /gp/customer-reviews/dynamic/sims-box
Disallow /review/dynamic/sims-box
Disallow /gp/redirect.html
Disallow /gp/twister/ajaxv2
Disallow /ss/twister/ajax
Disallow /b?*node=7454917011
Disallow /b?*node=7454927011
Disallow /b?*node=7454939011
Disallow /b?*node=7454898011
Disallow /gp/customer-media/actions/delete/
Disallow /gp/customer-media/actions/edit-caption/
Disallow /gp/dmusic/
Allow /gp/dmusic/promotions/PrimeMusic
Allow /gp/dmusic/promotions/AmazonMusicUnlimited
Disallow /gp/offer-listing/
Disallow /b?*node=9052533011
Disallow /lm/R1XIHQVKXSKBNJ
Disallow /lm/R3HQ5WJSZK6QSO
Disallow /surprise/
Disallow /local/ajax/
Disallow /gp/socialmedia/giveaways
Disallow /gp/b2b-rd
Disallow /gp/aw/so.html
Disallow /reviews/iframe
Disallow /gp/switch-language
Disallow /ga/p/
Disallow /gp/profile/
Disallow /giveaway/host/setup/
Disallow /ss/customer-reviews/lighthouse/
Disallow /ospublishing/story/*
Disallow /gp/aw/ol/
Disallow /gp/promotion/
Disallow /hz/leaderboard/top-reviewers/
Disallow /creatorhub
Disallow /creatorhub/*
Disallow /slp/s$
Disallow /-/
Allow /-/es/
Allow /-/en$
Allow /-/zh_TW/
Allow /-/zh_TW$
Allow /-/he/
Allow /-/he$
Disallow /hz/help/contact/*/message/$
Disallow /gp/aw/shoppingAids/
Disallow /rss/people/*/reviews
Disallow /gp/pdp/rss/*/reviews
Disallow /gp/cdp/member-reviews/
Disallow /gp/aw/cr/
Allow /gp/offer-listing/B000
Allow /gp/offer-listing/9000
Disallow /gp/aag
Allow /gp/aag/main?*seller=ABVFEJU8LS620
Disallow /gp/pdp/profile/
Disallow /gp/help/customer/express/c2c/
Disallow /slp/*/b$
Disallow /hz/contact-us/ajax/initiate-trusted-contact/
Disallow /hp/video/
Disallow /gp/video/api
Disallow /gp/video/settings
Disallow /gp/video/library
Disallow /gp/video/watchlist
Disallow /gp/video/mystuff
Disallow /gp/video/profiles
Disallow /gp/video/search
Disallow /gp/video/auth
Disallow /gp/video/salp/i

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /