uml.edu
robots.txt

Robots Exclusion Standard data for uml.edu

Resource Scan

Scan Details

Site Domain uml.edu
Base Domain uml.edu
Scan Status Ok
Last Scan2024-11-17T11:27:49+00:00
Next Scan 2024-12-17T11:27:49+00:00

Last Scan

Scanned2024-11-17T11:27:49+00:00
URL https://uml.edu/robots.txt
Redirect https://www.uml.edu/robots.txt
Redirect Domain www.uml.edu
Redirect Base uml.edu
Domain IPs 129.63.91.200
Redirect IPs 129.63.91.200
Response IP 129.63.91.200
Found Yes
Hash 44db4ae58d13c4f5565fa87b02a11ac3f20ac292bdb087aa1cb6a7c0a1f2cadd
SimHash cd1099664a64

Groups

monsidobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

cornell spider 3.0.0beta

Rule Path
Disallow /libraries/
Disallow /Libraries/

*

Rule Path
Allow /system/template/v5/
Allow /system/template/assets/
Allow /system/includes/
Disallow /directory/people.aspx
Disallow /registrar/transfer/classic.aspx
Disallow /search.aspx
Disallow /News/news-articles/2006/a_growing_ipod_hit_1.aspx
Disallow /cgi-bin/
Disallow /usage/
Disallow /stats/
Disallow /thinkoutloud/
Disallow /course/
Disallow /oldstuff/
Disallow /dickens/
Disallow /old/
Disallow /stage/
Disallow /stage-live/
Disallow /Dept/Biology/Ecology/
Disallow /archivestudent-services11082006/
Disallow /student-groups/
Disallow /student-groups/Spectrum/
Disallow /it/webservices/javier/
Disallow /registrar/term_fall/
Disallow /registrar/term_spring/
Disallow /registrar/term_summer/
Disallow /registrar/term_winter/
Disallow /registrar/transfer/
Disallow /media/
Disallow /cvd/
Disallow /ORA/
Disallow /404/
Disallow /access-services/
Disallow /accounts/
Disallow /adaservices/
Disallow /adaservices1/
Disallow /adaservices2/
Disallow /ADM/
Disallow /admindocs/
Disallow /administrationinterim/
Disallow /Album/
Disallow /applets/
Disallow /App_Code/
Disallow /ASA/
Disallow /aspnet_client/
Disallow /Athletics/
Disallow /awmData-menu/
Disallow /billw/
Disallow /bin/
Disallow /catalog-collage/
Disallow /catalog_AY06/
Disallow /catalog_AY07/
Disallow /catalog_AY08/
Disallow /catalog_AY09/
Disallow /catalog_AY10/
Disallow /catalog_AY11/
Disallow /catalog_AY12/
Disallow /catalog_AY13/
Disallow /catalog_AY14/
Disallow /cgi-bin/
Disallow /chat/
Disallow /citylives/
Disallow /CLASS2/
Disallow /clearinghouse/
Disallow /cleartxt/
Disallow /collage/
Disallow /collage_database/
Disallow /college/
Disallow /collegedept/
Disallow /collegesdept/
Disallow /com/
Disallow /customcontrols/
Disallow /Communications/
Disallow /commuter/
Disallow /comm_service/
Disallow /connect/
Disallow /Contribution%20Definitions/
Disallow /council/
Disallow /cvd/
Disallow /cybered/
Disallow /DCE/
Disallow /desroche/
Disallow /Dept/biology/
Disallow /Dept/Math/
Disallow /Dept/physics/
Disallow /Dept/psychology/
Disallow /dickens/
Disallow /discussion/
Disallow /Doug/
Disallow /downloads/
Disallow /editinfo/
Disallow /Editor/
Disallow /elections/
Disallow /EMS/
Disallow /EMSS/
Disallow /EMSWebware/
Disallow /epaems/
Disallow /FacultyBios/
Disallow /flash/
Disallow /g/
Disallow /gse/
Disallow /gallery/
Disallow /gerryflashstuff/
Disallow /google_mini/
Disallow /guidance/
Disallow /hawks/
Disallow /IDEA/
Disallow /ImageMagick-6.3.5-Q16/
Disallow /images/
Disallow /images2/
Disallow /images_beta/
Disallow /includes/
Disallow /info/
Disallow /ipvr/
Disallow /ITC2000/
Disallow /ITC99/
Disallow /itunes/
Disallow /isis/
Disallow /java/
Disallow /jw_mp3_player/
Disallow /KerouacConference/
Disallow /labor_extension/
Disallow /linkcatcher/
Disallow /lucas/
Disallow /mainpage/
Disallow /masterpages/
Disallow /mathforms/
Disallow /mba/
Disallow /media/
Disallow /menu/
Disallow /misc/
Disallow /msb/management50/tickets/
Disallow /nanomanufacturing/
Disallow /ncoe/
Disallow /neasc/
Disallow /newsletter/
Disallow /nosmoke/
Disallow /old/
Disallow /old%20frontpage/
Disallow /oldstuff/
Disallow /oma/
Disallow /oor/
Disallow /ORA/
Disallow /percussion/
Disallow /photocollageimages/
Disallow /photogallery/
Disallow /policy/
Disallow /poll/
Disallow /PPPserver/
Disallow /proj/
Disallow /Proxyserver/
Disallow /public_affairs/
Disallow /Profile-Expert/
Disallow /real/
Disallow /redirects/
Disallow /res/
Disallow /RideFinder/
Disallow /scriptsa/
Disallow /Search/
Disallow /searchstuff/
Disallow /server/
Disallow /serverdown/
Disallow /services/
Disallow /shoppingcart/
Disallow /Stage/
Disallow /stage/
Disallow /stage-live/
Disallow /stage-live/
Disallow /stats/
Disallow /student_affairs_newsletter/
Disallow /studsvcs/
Disallow /styles/
Disallow /system_old/
Disallow /system/
Disallow /System/
Disallow /System/aspx/
Disallow /teacher/
Disallow /techforce/
Disallow /telecomm/
Disallow /tempCalendar/
Disallow /Templates/
Disallow /test/
Disallow /testweb/
Disallow /theatrearts/
Disallow /transformation/
Disallow /Tsongas/
Disallow /TURI/
Disallow /uml10k/
Disallow /webcam/
Disallow /webcast/
Disallow /weboffice/
Disallow /websupport/
Disallow /welcome_back/
Disallow /academicaffairs/awards/
Disallow /admin/anf/
Disallow /admin/Copy%20of%20registrar/
Disallow /admin/finaid/
Disallow /admin/hr/
Disallow /admin/old/
Disallow /admin/ar/091604/
Disallow /admin/ar/oldweb81601/
Disallow /admin/ar/oldweb8800/
Disallow /admin/registrar/
Disallow /admindocs/_ScriptLibrary/
Disallow /advancement/advancement/
Disallow /advancement/communicate/
Disallow /advancement/evite/
Disallow /advancement/alumni/benefits/
Disallow /advancement/alumni/reunion/
Disallow /advancement/alumni/francis_cabot/pdf/
Disallow /advancement/alumni/
Disallow /advancement/alumni-hockey/
Disallow /advancement/alumni-newsletter/
Disallow /advancement/benefits/
Disallow /advancement/bioForm/
Disallow /advancement/calendar/
Disallow /advancement/celebration-philanthropy/
Disallow /advancement/classnotes/
Disallow /advancement/clone/
Disallow /advancement/communicate/
Disallow /advancement/corporate_relations/
Disallow /advancement/docs/
Disallow /advancement/events/
Disallow /advancement/evite/
Disallow /advancement/fallfestival/
Disallow /advancement/fclhonors/
Disallow /advancement/forms/
Disallow /advancement/fs_appreciation_night/
Disallow /advancement/give/
Disallow /advancement/images/
Disallow /advancement/maralago/
Disallow /advancement/maryjoannancy/
Disallow /advancement/newsroom/
Disallow /advancement/parents/
Disallow /advancement/pdf/
Disallow /advancement/plasticsalumni/
Disallow /advancement/points_of_pride/
Disallow /advancement/Publications/
Disallow /advancement/reports/
Disallow /advancement/reunion/
Disallow /advancement/scholarships/
Disallow /advancement/Social_Media/
Disallow /advancement/spotlight/
Disallow /advancement/staff/
Disallow /advancement/stringproject/
Disallow /advancement/success_stories/
Disallow /advancement/tickets/
Disallow /advancement/tripathy/
Disallow /advancement/yphockey/
Disallow /advancement/Donors/old/
Disallow /AFROTC/BBS/
Disallow /AFROTC/Cadet_Area/
Disallow /AFROTC/images/
Disallow /AFROTC/Inetpub/
Disallow /AFROTC/java/
Disallow /AFROTC/maps/
Disallow /AFROTC/SAV07/
Disallow /campusrecreation/06schedules/
Disallow /campusrecreation/campusRecreation/
Disallow /campusrecreation/campusrecreationarchive/
Disallow /campusrecreation/Templates/
Disallow /campusrecreation/intramurals/Brackets%20Fall%2007/
Disallow /campusrecreation/intramurals/buttons/
Disallow /campusrecreation/intramurals/Fall%2006%20Brackets/
Disallow /campusrecreation/intramurals/images/
Disallow /campusrecreation/intramurals/Spring%2007%20Brackets/
Disallow /campusrecreation/photogallery/
Disallow /centerforarts/09_06_05/
Disallow /centerforarts/old/
Disallow /centers/ces/
Disallow /centers/CHP/
Disallow /centers/CPHRHP/
Disallow /centers/CS3/
Disallow /centers/ctlrs/
Disallow /centers/FTC/
Disallow /centers/images/
Disallow /centers/IRB/
Disallow /centers/lcsp/
Disallow /centers/old/
Disallow /centers/phi/
Disallow /centers/CAM/old/
Disallow /centers/CAM/old2/
Disallow /centers/CAM/old3/
Disallow /centers/pacsi/10th_DWV_2005_files/
Disallow /centers/pacsi/Documents/
Disallow /centers/pacsi/DWV_2004_files/
Disallow /centers/pacsi/images/
Disallow /centers/pacsi/posters/
Disallow /centers/pacsi/images/sub/
Disallow /centers/pacsi/posters/Fellman_2003_files/
Disallow /centers/pacsi/posters/Ted_Postol_2004_files/
Disallow /citylives/oldsite/
Disallow /class/Freshtips05/
Disallow /class/maj_req/
Disallow /class/transtips05/
Disallow /class/ClassTutoring/
Disallow /class/docs/Freshtips05/
Disallow /class/docs/transtips05/
Disallow /cleartxt/images/
Disallow /commencement/commencement/
Disallow /commencement/commencement2003/
Disallow /commencement/commencement2004/
Disallow /commencement/images/
Disallow /commencement/newfront/
Disallow /commencement/oldcommencement/
Disallow /community/LIRA/Class_Schedules/fall07/
Disallow /community/LIRA/Class_Schedules/winter08/
Disallow /commuter/ridefinder/
Disallow /commuter/ridefinder/shuttle/
Disallow /connect/data/
Disallow /cybered/about/
Disallow /cybered/cert/
Disallow /cybered/desc/
Disallow /cybered/imgs/
Disallow /cybered/desc/nf_desc/
Disallow /cybered/imgs/coursecontent_imgs/
Disallow /Dept/Biology/
Disallow /Dept/images/
Disallow /Dept/Library/
Disallow /Dept/Math/
Disallow /Dept/Physics/
Disallow /Dept/PO/
Disallow /Dept/psychology/
Disallow /Dept/Art/A1OLDSITE/
Disallow /Dept/Art/flash/
Disallow /Dept/Art/gallery0708/
Disallow /Dept/Art/gallery_archive/
Disallow /Dept/Art/images/
Disallow /Dept/Art/newsitedesign/
Disallow /Dept/Art/news_archive/
Disallow /EHS/admin/
Disallow /EHS/bio/
Disallow /EHS/chem/
Disallow /EHS/crisismgnt/
Disallow /EHS/ehs/
Disallow /EHS/EHSBACKUP/
Disallow /EHS/fire/
Disallow /EHS/images/
Disallow /EHS/indhygiene/
Disallow /EHS/radio/
Disallow /EHS/team/
Disallow /EHS/waste_inventory/
Disallow /EHS/bio/forms/
Disallow /Enrollment/Michael_Belcher%27s_Folder/
Disallow /financialaid/scholarships/
Disallow /gened/copy%20of%20gened/
Disallow /hr/hr_archive/
Disallow /hr/jobpostings/archive/
Disallow /hr/images/
Disallow /hr/test/
Disallow /hr/benatglance/
Disallow /it/desktopsupport/
Disallow /it/helpboard/
Disallow /it/images/
Disallow /it/Maintenance/
Disallow /it/Projects/
Disallow /it/Reporting/
Disallow /it/Alerts/admin/
Disallow /it/current_students/Policies/
Disallow /it/current_students/ISIS_Tutorials/
Disallow /it/faculty_staff/iHEAT%20Tutorials/
Disallow /it/faculty_staff/pdfs/
Disallow /it/webservices/
Disallow /KerouacConference/archive/
Disallow /KerouacConference/beatattitudes/
Disallow /laborextension/old/
Disallow /laborextension/old2/
Disallow /Libraries/libdirectory/
Disallow /Libraries/Research_Help/Know%20How/
Disallow /media/
Disallow /nano/Storage/
Disallow /newsletter/evaluation/
Disallow /ombuds/old/
Disallow /photogallery/photo00002195/
Disallow /PoetryConference/old/
Disallow /PoetryConference/speakers/old/
Disallow /police/old/
Disallow /police/old03202005/
Disallow /police/oldpolice/
Disallow /procurement/archive100406/
Disallow /procurement/archives/
Disallow /pubic_affairs/
Disallow /RideFinder/ridefindergerry/
Disallow /student-groups/acctsoc/
Disallow /student-groups/activities/
Disallow /student-groups/ahc/
Disallow /student-groups/anime/
Disallow /student-groups/asao/
Disallow /student-groups/autoclub/
Disallow /student-groups/bioclub/
Disallow /student-groups/bmes/
Disallow /student-groups/ccet/
Disallow /student-groups/cheerleading/
Disallow /student-groups/cssa/
Disallow /student-groups/geo/
Disallow /student-groups/gsa/
Disallow /student-groups/hsa/
Disallow /student-groups/idrf/
Disallow /student-groups/images/
Disallow /student-groups/isa/
Disallow /student-groups/isa2/
Disallow /student-groups/isc/
Disallow /student-groups/karate/
Disallow /student-groups/kgsa/
Disallow /student-groups/lasa/
Disallow /student-groups/Library/
Disallow /student-groups/magik/
Disallow /student-groups/marketing/
Disallow /student-groups/meisa/
Disallow /student-groups/mis-society/
Disallow /student-groups/msa/
Disallow /student-groups/offbroadway/
Disallow /student-groups/psga/
Disallow /student-groups/psichi/
Disallow /student-groups/sasa/
Disallow /student-groups/SHPE/
Disallow /student-groups/Spectrum/
Disallow /student-groups/vsa/
Disallow /student-services/dean/
Disallow /student-services/enews/
Disallow /student-services/orient/
Disallow /student-services/parent/
Disallow /student-services/counseling/
Disallow /student-services/health/ImmRecord_files/
Disallow /student-services/health/illnesses/athlete/
Disallow /student-services/health/illnesses/colds/
Disallow /student-services/health/illnesses/concussion/
Disallow /student-services/health/illnesses/diet/
Disallow /student-services/health/illnesses/eating/
Disallow /student-services/health/illnesses/flu/
Disallow /student-services/health/illnesses/heat/
Disallow /student-services/health/illnesses/hiv_aids/
Disallow /student-services/health/illnesses/melanoma/
Disallow /student-services/health/illnesses/meningitis/
Disallow /student-services/health/illnesses/nausea/
Disallow /student-services/health/illnesses/poison/
Disallow /student-services/health/illnesses/stds/
Disallow /student-services/health/illnesses/strep/
Disallow /student-services/health/illnesses/sunburn/
Disallow /student-services/ministry/catholic/archive/
Disallow /student-services/ministry/Protestant/Test-Images/
Disallow /student-services/ministry/Protestant/Test-Pages/
Disallow /student-services/ministry/Protestant/Test-Thumbnails/
Disallow /student-services/reslife/faqold/
Disallow /student-services/reslife/NEACUHO/
Disallow /student-services/reslife/newhalls/
Disallow /student-services/reslife/old/
Disallow /student-services/reslife/old070706/
Disallow /student-services/reslife/online_housing_gateway/
Disallow /student-services/reslife/pdf/
Disallow /student-services/Transportation_Services/Documents/
Disallow /students/assets/
Disallow /students/back%20of%20old%20student%20folder/
Disallow /students/build/
Disallow /students/distributions/
Disallow /summercamps/images/
Disallow /sustainability/achievements/
Disallow /sustainability/Conserving_Nature/
Disallow /sustainability/context/
Disallow /sustainability/Economics_%26_Production/
Disallow /sustainability/Ethics_%26_Policy/
Disallow /sustainability/mandate/
Disallow /sustainability/suggesting/
Disallow /sustainability/vision/
Disallow /teacher/appreciation/
Disallow /thinkoutloud/wordpress/
Disallow /TNEC/archive_040307/
Disallow /TNEC/trainer_schedules/
Disallow /tripathysymposium/old/
Disallow /umasspoll/images/
Disallow /umasspoll/January%202005%20survey/
Disallow /umasspoll/previous/
Disallow /umasspoll/temp/
Disallow /uml10k/images/
Disallow /UML_EMS/about/
Disallow /UML_EMS/images/
Disallow /UML_EMS/music/
Disallow /UML_EMS/Pearl/
Disallow /UML_EMS/pictures/
Disallow /UML_EMS/protected/
Disallow /UML_EMS/protected2/
Disallow /UML_EMS/statistics_files/
Disallow /UML_EMS/stats_files/
Disallow /UML_EMS/tl008_Pos_Rprt_files/
Disallow /UML_EMS/training/
Disallow /UMasspoll/
Disallow /WUML/Sunrise/cool_stuff/Coolstuff_Archives/
Disallow /University-Relations/help/web-services/usability/
Disallow /University-Relations/University-Relations/Evite/
Disallow /admissions/waitlistoptinform.aspx
Disallow /Brightcove/
Disallow /download/
Disallow /login/
Disallow /resources/

slurp

Rule Path
Disallow /student-groups/
Disallow /student-groups/Spectrum/

twiceler

Rule Path
Disallow /student-groups/
Disallow /student-groups/Spectrum/

twitterbot

Rule Path
Allow /images/

Warnings

  • 4 invalid lines.