lens.org
robots.txt

Robots Exclusion Standard data for lens.org

Resource Scan

Scan Details

Site Domain lens.org
Base Domain lens.org
Scan Status Ok
Last Scan2025-12-02T09:56:20+00:00
Next Scan 2026-01-01T09:56:20+00:00

Last Scan

Scanned2025-12-02T09:56:20+00:00
URL https://lens.org/robots.txt
Redirect https://www.lens.org/robots.txt
Redirect Domain www.lens.org
Redirect Base lens.org
Domain IPs 35.86.27.244, 44.254.149.207, 52.35.147.141
Redirect IPs 35.86.27.244, 44.254.149.207, 52.35.147.141
Response IP 52.35.147.141
Found Yes
Hash dde2196315b1abd4119bd074e1df5c56814d16c34093ee065a4361d82615f161
SimHash 7016d178a20b

Groups

baiduspider
yandexbot
amazonbot
yisouspider
petalbot
dataforseobot
applebot
gptbot
ccbot
anthropic-ai
claude-web
google-extended
blexbot
ahrefsbot
semrushbot
facebookexternalhit
dotbot
awariorssbot
awariosmartbot
chatgpt-user
oai-searchbot
yisouspider
mj12bot
awariosmartbot
awariorssbot

Rule Path
Disallow /

meta-externalads
meta-webindexer
meta-externalagent

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

claude-user

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

*

Rule Path
Disallow /lens/search
Disallow /lens/patent
Disallow /lens/scholar
Disallow /lens/service
Disallow /lens/orcid
Disallow /lens/api
Disallow /lens/export/
Disallow /images/
Disallow /lens/js/
Disallow /lens/min/
Disallow /lens/patcite

Warnings

  • 1 invalid line.