biogeodb.stri.si.edu
robots.txt

Robots Exclusion Standard data for biogeodb.stri.si.edu

Resource Scan

Scan Details

Site Domain biogeodb.stri.si.edu
Base Domain si.edu
Scan Status Ok
Last Scan2025-09-30T01:43:17+00:00
Next Scan 2025-10-30T01:43:17+00:00

Last Scan

Scanned2025-09-30T01:43:17+00:00
URL https://biogeodb.stri.si.edu/robots.txt
Domain IPs 160.111.244.78
Response IP 160.111.244.78
Found Yes
Hash 42f653bf993ad09f863a89bcf150cbc2edf8e0404d3845e6ff99a014480d1e2e
SimHash 1c1ed900add6

Groups

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /