stanford.edu
robots.txt
Robots Exclusion Standard data for stanford.edu
Resource Scan
Scan Details
Site Domain | stanford.edu |
Base Domain | stanford.edu |
Scan Status | Ok |
Last Scan | 2024-10-19T23:03:27+00:00 |
Next Scan | 2024-11-18T23:03:27+00:00 |
Last Scan
Scanned | 2024-10-19T23:03:27+00:00 |
URL | https://stanford.edu/robots.txt |
Domain IPs | 171.67.215.200, 2607:f6d0:0:925a::ab43:d7c8 |
Response IP | 171.67.215.200 |
Found | Yes |
Hash | 447e0d45bfe9de3c1df309f222c01981995850e8640a2a25e3615697d37dff94 |
SimHash | b8007c4ceb12 |
Groups
*
Rule | Path |
---|---|
Disallow | /~folutade/ATI/ |
Disallow | /~neubank/Eubank_EthnicityNetworksPaper.pdf |
Disallow | /~neubank/Eubank_EthnicityNetworksPaper2016.pdf |
Disallow | /dept/soc/people/rsandefur/ |