amazon.ae
robots.txt

Robots Exclusion Standard data for amazon.ae

Resource Scan

Scan Details

Site Domain amazon.ae
Base Domain amazon.ae
Scan Status Ok
Last Scan2024-06-28T06:15:24+00:00
Next Scan 2024-07-05T06:15:24+00:00

Last Scan

Scanned2024-06-28T06:15:24+00:00
URL https://amazon.ae/robots.txt
Redirect https://www.amazon.ae/robots.txt
Redirect Domain www.amazon.ae
Redirect Base amazon.ae
Domain IPs 52.95.113.159, 52.95.118.2, 52.95.120.33
Redirect IPs 108.156.133.120, 108.156.133.19, 108.156.133.49, 108.156.133.78, 2600:1417:3f::b81c:eb51, 2600:1417:3f::b81c:eb69
Response IP 23.59.168.171
Found Yes
Hash 63316a251864bf4749ee77870676ac242c5683c6983becc09e6809f38e881d32
SimHash 447b0efb2faf

Groups

*

Rule Path
Disallow /dp/product-availability/
Disallow /dp/rate-this-item/
Disallow /exec/obidos/account-access-login
Disallow /exec/obidos/change-style
Disallow /exec/obidos/dt/assoc/handle-buy-box
Disallow /exec/obidos/flex-sign-in
Disallow /exec/obidos/handle-buy-box
Disallow /exec/obidos/refer-a-friend-login
Disallow /exec/obidos/subst/associates/join
Disallow /exec/obidos/subst/marketplace/sell-your-collection.html
Disallow /exec/obidos/subst/marketplace/sell-your-stuff.html
Disallow /exec/obidos/subst/partners/friends/access.html
Disallow /exec/obidos/tg/cm/member/
Disallow /gp/cart
Disallow /gp/content-form
Disallow /gp/customer-images
Disallow /gp/customer-media/upload
Disallow /gp/customer-reviews/common/du
Disallow /gp/customer-reviews/write-a-review.html
Disallow /gp/flex
Disallow /gp/gfix
Disallow /gp/history
Disallow /gp/item-dispatch
Disallow /gp/legacy-handle-buy-box.html
Disallow /gp/reader
Disallow /gp/registry/wishlist/*/reserve
Disallow /gp/richpub/listmania/createpipeline
Disallow /gp/music/clipserve
Disallow /gp/recsradio
Disallow /gp/sign-in
Disallow /gp/slides/make-money
Disallow /gp/structured-ratings/actions/get-experience.html
Disallow /gp/twitter/
Disallow /gp/vote
Disallow /gp/voting/
Disallow /gp/yourstore
Disallow /ap/signin
Disallow /gp/registry/search.html
Disallow /gp/orc/rml/
Disallow /gp/dmusic/mp3/player
Disallow /gp/entity-alert/external
Disallow /gp/customer-reviews/dynamic/sims-box
Disallow /review/dynamic/sims-box
Disallow /gp/redirect.html
Disallow /gp/customer-media/actions/delete/
Disallow /gp/customer-media/actions/edit-caption/
Disallow /gp/dmusic/
Disallow /gp/customer-media/product-gallery/B007HCCOD0
Disallow /gp/help/customer/display.html?*nodeId=200534000
Disallow /gp/feature.html?*docId=1000632623
Disallow /gp/aag
Disallow /gp/socialmedia/giveaways
Disallow /gp/aw/so.html
Disallow /gp/pdp/profile/
Disallow /gp/product/product-availability
Disallow /gp/offer-listing
Disallow /dp/twister-update/
Disallow /dp/e-mail-friend/
Disallow /gp/registry/wishlist/
Disallow /wishlist/
Allow /wishlist/universal
Allow /wishlist/vendor-button
Allow /wishlist/get-button
Disallow /gp/wishlist/
Allow /gp/wishlist/universal
Allow /gp/wishlist/vendor-button
Allow /gp/wishlist/ipad-install
Disallow /registry/wishlist/
Disallow /local/ajax/
Disallow /gp/rentallist
Disallow /gp/video/dvd-rental/settings
Disallow /gp/rl/settings
Disallow /gp/video/settings
Disallow /gp/video/watchlist
Disallow /gp/video/library
Disallow /gp/profile/
Disallow /reviews/iframe
Disallow /ss/customer-reviews/lighthouse/
Disallow /ar/gp/goldbox/
Disallow /gp/ask-widget/
Disallow /gp/cerberus/
Disallow /-/
Allow /-/ar/
Allow /-/ar$
Disallow /hz/help/contact/*/message/$
Disallow /gp/aw/shoppingAids/
Disallow /hz/contact-us/ajax/initiate-trusted-contact/

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /