ocf.berkeley.edu
robots.txt

Robots Exclusion Standard data for ocf.berkeley.edu

Resource Scan

Scan Details

Site Domain ocf.berkeley.edu
Base Domain berkeley.edu
Scan Status Ok
Last Scan2024-05-16T11:35:10+00:00
Next Scan 2024-05-30T11:35:10+00:00

Last Scan

Scanned2024-05-16T11:35:10+00:00
URL https://ocf.berkeley.edu/robots.txt
Redirect https://www.ocf.berkeley.edu/robots.txt
Redirect Domain www.ocf.berkeley.edu
Redirect Base berkeley.edu
Domain IPs 169.229.226.23, 2607:f140:8801::1:23
Redirect IPs 169.229.226.23, 2607:f140:8801::1:23
Response IP 169.229.226.23
Found Yes
Hash 5940c4cf78820f709a92d50430e5e239a0e27e97321a5700fa908f77533df444
SimHash 49328006cd1a

Groups

*

Rule Path
Disallow /login/calnet/
Disallow /test/
Disallow /tv/
Disallow /api/