Log In Sign Up

people.csail.mit.edu
robots.txt

Robots Exclusion Standard data for people.csail.mit.edu

Resource Scan

Scan Details

Site Domain people.csail.mit.edu
Base Domain mit.edu
Scan Status Ok
Last Scan2025-10-30T02:55:39+00:00
Next Scan 2025-11-29T02:55:39+00:00

Last Scan

Scanned2025-10-30T02:55:39+00:00
URL https://people.csail.mit.edu/robots.txt
Domain IPs 128.52.131.233
Response IP 128.52.131.233
Found Yes
Hash 4f2bca407448c0441c93992160ab72ddb338a5d99cf8caf3cb525eb6aa28d579
SimHash 6c07a24b8f12

Groups

*

Rule Path
Disallow /klivescu/twiki/bin/attach.cgi
Disallow /klivescu/twiki/bin/changes.cgi
Disallow /klivescu/twiki/bin/edit.cgi
Disallow /klivescu/twiki/bin/geturl.cgi
Disallow /klivescu/twiki/bin/installpasswd.cgi
Disallow /klivescu/twiki/bin/mailnotify.cgi
Disallow /klivescu/twiki/bin/manage.cgi
Disallow /klivescu/twiki/bin/oops.cgi
Disallow /klivescu/twiki/bin/passwd.cgi
Disallow /klivescu/twiki/bin/preview.cgi
Disallow /klivescu/twiki/bin/rdiff.cgi
Disallow /klivescu/twiki/bin/rdiffauth.cgi
Disallow /klivescu/twiki/bin/register.cgi
Disallow /klivescu/twiki/bin/rename.cgi
Disallow /klivescu/twiki/bin/save.cgi
Disallow /klivescu/twiki/bin/savemulti.cgi
Disallow /klivescu/twiki/bin/search.cgi
Disallow /klivescu/twiki/bin/setlib.cfg.cgi
Disallow /klivescu/twiki/bin/statistics.cgi
Disallow /klivescu/twiki/bin/testenv.cgi
Disallow /klivescu/twiki/bin/configure.cgi
Disallow /klivescu/twiki/bin/upload.cgi
Disallow /klivescu/twiki/bin/viewauth.cgi
Disallow /klivescu/twiki/bin/viewfile.cgi
Disallow /paulfitz/cosmic/cosmic.0.9/bin/drawgate-ppm.pl
Back to top

Comments

  • klivescu's got a twiki installation in their home dir....
Back to top