awscfdns.com
robots.txt

Robots Exclusion Standard data for awscfdns.com

Resource Scan

Scan Details

Site Domain awscfdns.com
Base Domain awscfdns.com
Scan Status Ok
Last Scan2025-12-23T06:37:03+00:00
Next Scan 2025-12-30T06:37:03+00:00

Last Scan

Scanned2025-12-23T06:37:03+00:00
URL https://www.awscfdns.com/robots.txt
Domain IPs 2600:9000:2077:0:b:f504:b580:93a1, 2600:9000:2077:3800:b:f504:b580:93a1, 2600:9000:2077:400:b:f504:b580:93a1, 2600:9000:2077:7a00:b:f504:b580:93a1, 2600:9000:2077:9200:b:f504:b580:93a1, 2600:9000:2077:c400:b:f504:b580:93a1, 2600:9000:2077:c600:b:f504:b580:93a1, 2600:9000:2077:e000:b:f504:b580:93a1, 52.84.150.36, 52.84.150.45, 52.84.150.59, 52.84.150.60
Response IP 52.84.150.59
Found Yes
Hash ee889dbdddd1dce138b2f139bd00d707d0cdcded2df5838ec5d1d3d424c785e4
SimHash 46a38a1be5bf

Groups

*

Rule Path
Disallow /exec/obidos/account-access-login
Disallow /exec/obidos/change-style
Disallow /exec/obidos/flex-sign-in
Disallow /exec/obidos/handle-buy-box
Disallow /exec/obidos/tg/cm/member/
Disallow /gp/aw/help/id%3Dsss
Disallow /gp/cart
Disallow /gp/flex
Disallow /gp/product/e-mail-friend
Disallow /gp/product/product-availability
Disallow /gp/product/rate-this-item
Disallow /gp/sign-in
Disallow /gp/reader
Disallow /gp/sitbv3/reader
Disallow /gp/richpub/syltguides/create
Disallow /gp/gfix
Disallow /gp/associations/wizard.html
Disallow /gp/dmusic/order
Disallow /gp/legacy-handle-buy-box.html
Disallow /gp/aws/ssop
Disallow /gp/yourstore
Disallow /gp/gift-central/organizer/add-wishlist
Disallow /gp/vote
Disallow /gp/voting/
Disallow /gp/music/wma-pop-up
Disallow /gp/customer-images
Disallow /gp/richpub/listmania/createpipeline
Disallow /gp/content-form
Disallow /gp/pdp/invitation/invite
Disallow /gp/customer-reviews/common/du
Disallow /gp/customer-reviews/write-a-review.html
Disallow /gp/associations/wizard.html
Disallow /gp/music/clipserve
Disallow /gp/customer-media/upload
Disallow /gp/history
Disallow /gp/item-dispatch
Disallow /gp/dmusic/order/handle-buy-box.html
Disallow /gp/recsradio
Disallow /gp/slredirect
Disallow /dp/shipping/
Disallow /dp/twister-update/
Disallow /dp/manual-submit/
Disallow /dp/e-mail-friend/
Disallow /dp/product-availability/
Disallow /dp/rate-this-item/
Disallow /gp/registry/wishlist/*/reserve
Disallow /gp/structured-ratings/actions/get-experience.html
Disallow /gp/twitter/
Disallow /ap/signin
Disallow /gp/registry/wishlist/
Disallow /wishlist/
Allow /wishlist/universal*
Allow /wishlist/vendor-button*
Allow /wishlist/get-button*
Disallow /gp/wishlist/
Allow /gp/wishlist/universal*
Allow /gp/wishlist/vendor-button*
Allow /gp/wishlist/ipad-install*
Disallow /registry/wishlist/
Disallow /review/common/du
Disallow /gp/registry/search.html
Disallow /product-reviews/B0069IY63Y
Disallow /gp/orc/rml/
Disallow */gcrnsts
Disallow /gp/gc/widget
Disallow /gp/dmusic/mp3/player
Disallow /gp/entity-alert/external
Disallow /gp/customer-reviews/dynamic/sims-box
Disallow /review/dynamic/sims-box
Disallow /gp/redirect.html
Disallow /gp/twister/ajaxv2
Disallow /ss/twister/ajax
Disallow /b?*node=7454917011
Disallow /b?*node=7454927011
Disallow /b?*node=7454939011
Disallow /b?*node=7454898011
Disallow /gp/customer-media/actions/delete/
Disallow /gp/customer-media/actions/edit-caption/
Disallow /gp/dmusic/
Allow /gp/dmusic/promotions/PrimeMusic
Allow /gp/dmusic/promotions/AmazonMusicUnlimited
Disallow /gp/offer-listing/
Disallow /b?*node=9052533011
Disallow /lm/R1XIHQVKXSKBNJ
Disallow /lm/R3HQ5WJSZK6QSO
Disallow /surprise/
Disallow /local/ajax/
Disallow /gp/socialmedia/giveaways
Disallow /gp/b2b-rd
Disallow /gp/aw/so.html
Disallow /reviews/iframe
Disallow /gp/switch-language
Disallow /ga/p/
Disallow /gp/profile/
Disallow /giveaway/host/setup/
Disallow /ss/customer-reviews/lighthouse/
Disallow /ospublishing/story/*
Disallow /gp/aw/ol/
Disallow /gp/promotion/
Disallow /hz/leaderboard/top-reviewers/
Disallow /creatorhub
Disallow /creatorhub/*
Disallow /slp/s$
Disallow /-/
Allow /-/es/
Allow /-/en$
Allow /-/zh_TW/
Allow /-/zh_TW$
Allow /-/he/
Allow /-/he$
Disallow /hz/help/contact/*/message/$
Disallow /gp/aw/shoppingAids/
Disallow /rss/people/*/reviews
Disallow /gp/pdp/rss/*/reviews
Disallow /gp/cdp/member-reviews/
Disallow /gp/aw/cr/
Allow /gp/offer-listing/B000
Allow /gp/offer-listing/9000
Disallow /gp/aag
Allow /gp/aag/main?*seller=ABVFEJU8LS620
Disallow /gp/pdp/profile/
Disallow /gp/help/customer/express/c2c/
Disallow /slp/*/b$
Disallow /hz/contact-us/ajax/initiate-trusted-contact/
Disallow /hp/video/
Disallow /gp/video/api
Disallow /gp/video/settings
Disallow /gp/video/library
Disallow /gp/video/watchlist
Disallow /gp/video/mystuff
Disallow /gp/video/profiles
Disallow /gp/video/search
Disallow /gp/video/auth
Disallow /gp/video/salp/i
Disallow /icdp/

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googleagent-mariner

Rule Path
Disallow /

googleagent-shopping

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

devin

Rule Path
Disallow /

omgili

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

gemini-deep-research

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

mistralai-user

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

google-notebooklm

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

copilot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

wpbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

youbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

isscyberriskcrawler

Rule Path
Disallow /

copilotnative

Rule Path
Disallow /

copilotsapphire

Rule Path
Disallow /

imgproxy

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /