fujimorilab.ucsf.edu
robots.txt

Robots Exclusion Standard data for fujimorilab.ucsf.edu

Resource Scan

Scan Details

Site Domain fujimorilab.ucsf.edu
Base Domain ucsf.edu
Scan Status Ok
Last Scan2025-06-07T03:35:42+00:00
Next Scan 2025-07-07T03:35:42+00:00

Last Scan

Scanned2025-06-07T03:35:42+00:00
URL https://fujimorilab.ucsf.edu/robots.txt
Domain IPs 199.34.228.55, 199.34.228.56, 199.34.228.57, 199.34.228.58, 199.34.228.59
Response IP 199.34.228.59
Found Yes
Hash e3e43b5a4c812fb824ba69dae5e1e419b9ff6050ba92d8542c30094f860da499
SimHash 0854dc542f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://fujimorilab.ucsf.edu/sitemap.xml