legendarywhitetails.com
robots.txt

Robots Exclusion Standard data for legendarywhitetails.com

Resource Scan

Scan Details

Site Domain legendarywhitetails.com
Base Domain legendarywhitetails.com
Scan Status Ok
Last Scan2026-02-28T16:38:56+00:00
Next Scan 2026-03-30T16:38:56+00:00

Last Scan

Scanned2026-02-28T16:38:56+00:00
URL https://www.legendarywhitetails.com/robots.txt
Domain IPs 104.18.36.82, 172.64.151.174
Response IP 104.18.36.82
Found Yes
Hash 96a8ad5ea5c0aa4a1b943bb8a301c20c567c6b2bf740d1c89f1fca352b7b99ac
SimHash 23e61550e779

Groups

screaming frog seo spider

Rule Path
Allow /

*

Rule Path
Disallow /account*
Disallow /cart*
Disallow /checkout*
Disallow /search*
Disallow /wishlist*
Disallow /order-confirmation*
Disallow /product-print*
Disallow /*srule%3D*
Disallow /*start%3D*
Disallow /*sz%3D*
Disallow /*SetZipCodeCore*
Disallow /googlefetch*
Disallow /*pmin*
Disallow /*_bta_c*
Disallow /*dwvar*
Disallow /*params*
Disallow /*pid*
Disallow /*pmax*
Disallow /*prefn1*
Disallow */Search-UpdateGrid*
Disallow */params%3D%7B*

amazonbot

Rule Path
Disallow /do-not-crawl/

amazonbot

Rule Path
Disallow /not-allowed/

amazonbot

Rule Path
Disallow /

amazonproductdiscovery

Rule Path
Disallow /do-not-crawl/

amazonproductdiscovery

Rule Path
Disallow /not-allowed/

amazonproductdiscovery

Rule Path
Disallow /

amazonproductdiscovery/1.0

Rule Path
Disallow /not-allowed/

amazonproductdiscoverybot

Rule Path
Disallow /

amazonproductdiscovery

Rule Path
Disallow /

amazonproductdiscoverybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazon-bedrock-agentcore-browser

Rule Path
Disallow /

amazon-qbusiness

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

*

Rule Path
Disallow /spring-into-deals

*

Rule Path
Disallow /friends-and-family

*

Rule Path
Disallow /stock-up-for-fall-sale

*

Rule Path
Disallow /shirt-jackets-sale

*

Rule Path
Disallow /flannel-sale

Other Records

Field Value
sitemap https://www.legendarywhitetails.com/sitemap_index.xml

Comments

  • Block Amazon Product Discovery (Price/Inventory Scraping)
  • Block Amazon General Crawler (Alexa/Search)
  • Block Amazon AI & Bedrock Agents

Warnings

  • 1 invalid line.