joiipetcare.com
robots.txt

Robots Exclusion Standard data for joiipetcare.com

Resource Scan

Scan Details

Site Domain joiipetcare.com
Base Domain joiipetcare.com
Scan Status Ok
Last Scan2025-05-02T22:53:15+00:00
Next Scan 2025-05-16T22:53:15+00:00

Last Scan

Scanned2025-05-02T22:53:15+00:00
URL https://joiipetcare.com/robots.txt
Redirect https://www.joiipetcare.com/robots.txt
Redirect Domain www.joiipetcare.com
Redirect Base joiipetcare.com
Domain IPs 104.22.78.72, 104.22.79.72, 172.67.37.182, 2606:4700:10::6816:4e48, 2606:4700:10::6816:4f48, 2606:4700:10::ac43:25b6
Redirect IPs 104.22.78.72, 104.22.79.72, 172.67.37.182, 2606:4700:10::6816:4e48, 2606:4700:10::6816:4f48, 2606:4700:10::ac43:25b6
Response IP 172.67.37.182
Found Yes
Hash 41d6a24089aadd0cceabeed66b882b55f38056ac440b82bffb9dcb223b682d43
SimHash 7994fbe0d616

Groups

chatgptbot

Rule Path
Disallow /

openai-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

googlebot-ml

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropicai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

deepmind

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Comments

  • OpenAI Bots
  • Google Bots
  • Anthropic Bots
  • Perplexity AI Bots
  • Amazon Bots
  • Facebook Bots
  • Apple Bots
  • DeepMind Bots
  • Bytespider (ByteDance/TikTok)
  • Diffbot
  • Imagesift
  • Omgili Bots
  • Other/Unclassified Bots