Log In Sign Up

research.ebsco.com
robots.txt

Robots Exclusion Standard data for research.ebsco.com

Resource Scan

Scan Details

Site Domain research.ebsco.com
Base Domain ebsco.com
Scan Status Ok
Last Scan2025-10-29T23:56:09+00:00
Next Scan 2025-11-28T23:56:09+00:00

Last Scan

Scanned2025-10-29T23:56:09+00:00
URL https://research.ebsco.com/robots.txt
Domain IPs 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52
Response IP 199.232.115.52
Found Yes
Hash 974c8993898b5077b50d933e3252a3f9cd7ce7c6ead52a96624cfb985dc69ee7
SimHash 7232c949c2f1

Groups

*

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

ai-crawler

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

mistralai-user

Rule Path
Disallow /

omgili

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

youbot

Rule Path
Disallow /
Back to top

Comments

  • ============================
  • Default Rule: Block All Bots
  • ============================
  • ============================
  • Documented AI/LLM Bot Blocks
  • ============================
  • The following are already blocked by the default * rule above.
  • They are listed here for clarity and reference.
Back to top