alfajewelry.com
robots.txt

Robots Exclusion Standard data for alfajewelry.com

Resource Scan

Scan Details

Site Domain alfajewelry.com
Base Domain alfajewelry.com
Scan Status Ok
Last Scan2026-02-19T03:52:44+00:00
Next Scan 2026-03-05T03:52:44+00:00

Last Scan

Scanned2026-02-19T03:52:44+00:00
URL https://alfajewelry.com/robots.txt
Domain IPs 172.66.40.160, 172.66.43.96, 2606:4700:3108::ac42:28a0, 2606:4700:3108::ac42:2b60
Response IP 172.66.43.96
Found Yes
Hash 5794018413708f47fce5b5bd374aa78e9e696fc5f46dd3e0b807f0fe4d154184
SimHash 79320f52add9

Groups

pinterest

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

pinterest/0.2

Rule Path
Allow /

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkout
Disallow /checkouts/
Disallow /54937157787/checkouts/
Disallow /54937157787/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /policies/
Disallow /*/policies/
Disallow /search
Disallow /a/downloads/
Disallow /apple-app-site-association
Disallow /cdn/wpm/
Disallow /recommendations/products
Disallow /*/recommendations/products
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /collections/vendors/
Allow /.well-known/

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

googlebot

Rule Path
Allow /

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

ccbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

applebot

Rule Path
Allow /

applebot-extended

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

slackbot

Rule Path
Allow /

googleother

Rule Path
Allow /

diffbot

Rule Path
Allow /

coherellmbot

Rule Path
Allow /

youbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://alfajewelry.com/sitemap.xml
sitemap https://alfajewelry.com/sitemap-en.xml
sitemap https://alfajewelry.com/sitemap-es.xml

Comments

  • Pinterest Rich Pins support - MUST be first (ensures full access)
  • Shopify Default Rules + Custom Optimizations
  • Block Chinese spiders and specific SEO tools
  • Explicit allow for Googlebot (SEO clarity)
  • AI & preview bots — ALLOW (max visibility)

Warnings

  • 2 invalid lines.