Log In Sign Up

piyogapants.com
robots.txt

Robots Exclusion Standard data for piyogapants.com

Resource Scan

Scan Details

Site Domain piyogapants.com
Base Domain piyogapants.com
Scan Status Ok
Last Scan2026-02-08T00:47:23+00:00
Next Scan 2026-02-22T00:47:23+00:00

Last Scan

Scanned2026-02-08T00:47:23+00:00
URL https://piyogapants.com/robots.txt
Redirect https://www.piyogapants.com/robots.txt
Redirect Domain www.piyogapants.com
Redirect Base piyogapants.com
Domain IPs 104.21.29.193, 172.67.149.171, 2606:4700:3030::6815:1dc1, 2606:4700:3035::ac43:95ab
Redirect IPs 23.227.38.74, 2620:127:f00f:e::
Response IP 23.227.38.74
Found Yes
Hash 66cd6f426c8e9ff253da0d4c5062da3c889f0cb25279697a2cc934413455512c
SimHash 08149810d6e5

Groups

*

Rule Path
Allow /

googlebot
google-extended
oai-searchbot
chatgpt-user
perplexitybot
perplexity-user
claude-searchbot
claude-user

Rule Path
Allow /products/
Allow /collections/

amazonbot
applebot-extended
bytespider
ccbot
gptbot
claudebot
meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /account
Disallow /search
Back to top

Other Records

Field Value
sitemap https://www.piyogapants.com/sitemap.xml
Back to top

Comments

  • --- 1. CLOUDFLARE CONTENT SIGNALS POLICY ---
  • (Keep this text; it sets your legal intent for 2026 AI laws)
  • search: yes | ai-input: yes | ai-train: no
  • --- 2. ALLOW AI SEARCH (TRAFFIC DRIVERS) ---
  • We list these specifically to override any broad blocks.
  • --- 3. BLOCK AI TRAINING (DATA PROTECTION) ---
  • These bots ONLY scrape data to build their models, not to send you traffic.
  • --- 4. SHOPIFY SECURITY & SPAM PROTECTION ---
  • (The rest of your Shopify-specific blocks go here)
  • ... (keep the rest of your long Shopify list here)
Back to top

Warnings

  • `content-signal` is not a known field.
Back to top