snap.stanford.edu
robots.txt

Robots Exclusion Standard data for snap.stanford.edu

Resource Scan

Scan Details

Site Domain snap.stanford.edu
Base Domain stanford.edu
Scan Status Ok
Last Scan2025-07-01T19:26:41+00:00
Next Scan 2025-07-31T19:26:41+00:00

Last Scan

Scanned2025-07-01T19:26:41+00:00
URL https://snap.stanford.edu/robots.txt
Domain IPs 171.64.75.80
Response IP 171.64.75.80
Found Yes
Hash 76f70f7e1aed339a26e3fe77ab45ba4a9c6a99815a8ac6cc703f2a289126ee68
SimHash 3c289c22e3f6

Groups

*

Rule Path
Disallow /class/cs224w-videos/
Disallow /class/cs224w-videos-2012/
Disallow /class/cs224w-videos-2013/
Disallow /class/cs224w-videos-2014/
Disallow /class/cs224w-videos-2015/
Disallow /class/cs246-video-2013/
Disallow /class/cs246-videos/
Disallow /class/cs246-videos-2014/
Disallow /class/cs246-videos-2015/
Disallow /class/cs341-videos/