infolab.stanford.edu
robots.txt

Robots Exclusion Standard data for infolab.stanford.edu

Resource Scan

Scan Details

Site Domain infolab.stanford.edu
Base Domain stanford.edu
Scan Status Ok
Last Scan2025-06-24T15:10:18+00:00
Next Scan 2025-07-24T15:10:18+00:00

Last Scan

Scanned2025-06-24T15:10:18+00:00
URL http://infolab.stanford.edu/robots.txt
Domain IPs 171.64.75.45
Response IP 171.64.75.45
Found Yes
Hash 521d33d8e88dafe8fb15b70533b275a20b6ae8b03ea52f0272ddbc79304278e9
SimHash 1b50594029d6

Groups

*

Rule Path
Disallow /~testbed
Disallow /~jure/pub

Comments

  • Nobody should index thel testbed directory structure (30-Nov-96 /ACK)