py.mit.edu
robots.txt

Robots Exclusion Standard data for py.mit.edu

Resource Scan

Scan Details

Site Domain py.mit.edu
Base Domain mit.edu
Scan Status Ok
Last Scan2025-08-31T02:33:58+00:00
Next Scan 2025-09-30T02:33:58+00:00

Last Scan

Scanned2025-08-31T02:33:58+00:00
URL https://py.mit.edu/robots.txt
Domain IPs 18.25.4.176
Response IP 18.25.4.176
Found Yes
Hash a761f19aa486c255c80372e0547113d1d275323c94508f3db2630f77fc4d7520
SimHash 0c555940c7d0

Groups

*

Rule Path
Disallow /

googlebot
adsbot-google

Rule Path
Disallow /