mintedmethodshop.com
robots.txt

Robots Exclusion Standard data for mintedmethodshop.com

Resource Scan

Scan Details

Site Domain mintedmethodshop.com
Base Domain mintedmethodshop.com
Scan Status Ok
Last Scan2025-10-23T04:37:05+00:00
Next Scan 2025-11-06T04:37:05+00:00

Last Scan

Scanned2025-10-23T04:37:05+00:00
URL https://mintedmethodshop.com/robots.txt
Redirect https://www.mintedmethod.com/robots.txt
Redirect Domain www.mintedmethod.com
Redirect Base mintedmethod.com
Domain IPs 23.227.38.32
Redirect IPs 23.227.38.74, 2620:127:f00f:e::
Response IP 23.227.38.74
Found Yes
Hash f0f37ad366939a45da58873392326dc7d6e9dee2777fc5ca144b42215b62f8ac
SimHash 79d4bf10c710

Groups

chatgpt-user

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

claude-searchbot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

*

Rule Path
Disallow /collections/*?*sort_by=
Disallow /collections/*?page=
Disallow /collections/*%2Bsale
Disallow /collections/*%2Bnew
Disallow /collections/6-*
Disallow /collections/toddler-sale.atom
Disallow /collections/*%2Bbest-sellers
Disallow /tags
Disallow /*.atom

Other Records

Field Value
sitemap https://www.mintedmethod.com/sitemap.xml

Comments

  • Allow AI crawlers
  • Default block rules for everything else