cmu.edu
robots.txt

Robots Exclusion Standard data for cmu.edu

Resource Scan

Scan Details

Site Domain cmu.edu
Base Domain cmu.edu
Scan Status Ok
Last Scan2024-06-12T03:44:18+00:00
Next Scan 2024-07-12T03:44:18+00:00

Last Scan

Scanned2024-06-12T03:44:18+00:00
URL https://cmu.edu/robots.txt
Redirect https://www.cmu.edu/robots.txt
Redirect Domain www.cmu.edu
Redirect Base cmu.edu
Domain IPs 128.2.42.10
Redirect IPs 128.2.42.52
Response IP 128.2.42.52
Found Yes
Hash ac2ad0495a0c6e6cbead5ad03023b87c913708783e518126067eb29d6b96f41d
SimHash 5844c1c66b11

Groups

*

Rule Path
Disallow /cmufront/
Disallow /myandrew
Disallow /homepage/health/2009/fall/nobel-prize.shtml