Log In Sign Up

polaris.shopify.com
robots.txt

Robots Exclusion Standard data for polaris.shopify.com

Resource Scan

Scan Details

Site Domain polaris.shopify.com
Base Domain shopify.com
Scan Status Ok
Last Scan2025-07-31T17:21:00+00:00
Next Scan 2025-08-30T17:21:00+00:00

Last Scan

Scanned2025-07-31T17:21:00+00:00
URL https://polaris.shopify.com/robots.txt
Redirect https://polaris-react.shopify.com/robots.txt
Redirect Domain polaris-react.shopify.com
Redirect Base shopify.com
Domain IPs 185.146.173.20
Redirect IPs 34.36.24.87
Response IP 34.36.24.87
Found Yes
Hash eee799bc660ea8a44beff8b5bd46070f33ca5cb032ef94d67971603f809e5ef1
SimHash 10b0da00a412

Groups

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /
Back to top

Comments

  • Block OpenAI's crawler
  • Block Anthropic's crawler
  • Block Google's AI crawler
  • Block Perplexity
  • Block Meta/Facebook AI
  • Block other common AI crawlers
Back to top