mtu.edu
robots.txt

Robots Exclusion Standard data for mtu.edu

Resource Scan

Scan Details

Site Domain mtu.edu
Base Domain mtu.edu
Scan Status Ok
Last Scan2024-10-21T07:26:19+00:00
Next Scan 2024-11-20T07:26:19+00:00

Last Scan

Scanned2024-10-21T07:26:19+00:00
URL https://mtu.edu/robots.txt
Redirect https://www.mtu.edu/robots.txt
Redirect Domain www.mtu.edu
Redirect Base mtu.edu
Domain IPs 141.219.70.117
Redirect IPs 104.18.2.133, 104.18.3.133, 2606:4700::6812:285, 2606:4700::6812:385
Response IP 104.18.3.133
Found Yes
Hash 05ba635e084a804051676badeeafa82cc48c453c31ded633c01381739c2c5865
SimHash 2e121b018598

Groups

*

Rule Path Comment
Disallow /eds temporary stuff
Disallow /four future designs and history presentation stuff
Disallow /old old stuff
Disallow /history old stuff
Disallow /apply/disabled_keep/ down-time files and old stuff
Disallow /mtuonly private stuff
Disallow /level4/mtfcampaign/ redirected site
Disallow /greatevents old stuff
Disallow /cie/sa/ redirected site
Disallow /athletics testing zone--use www.athletics.mtu.edu
Disallow /index_n.html homepage wannabe
Disallow /index_n1.html homepage wannabe
Disallow /index_n2.html homepage wannabe
Disallow /index_n3.html homepage wannabe
Disallow /index_n4.html homepage wannabe
Disallow /index_testing.html homepage testing zone
Disallow /index-3tabs.php homepage testing 3tab site
Disallow /index_alert.html holding spot for crisis situation
Disallow /index_snow holding spot for snow situation (design 2)
Disallow /urel/policy/mtu_web.html draft not yet approved
Disallow /adminresources old information
Disallow /cie website moved to ips server
Disallow /catalog/2000-02 2000-02 Undergradaute Catalog
Disallow /catalog/2002-04 2002-04 Undergraduate Catalog
Disallow /openhouse/index_archive_save/ indices that rotate in
Disallow /adminresources/old/ moved for Ann Roth
Disallow /wwwhelp/disabled/ old logos
Disallow /test test files
Disallow /index_save old files
Disallow /banners/ don't want these on hit stats
Disallow /2002/ -
Disallow /2003/ -
Disallow /five/ -
Disallow /fall02/ -
Disallow /level2/ -
Disallow /level3/ -
Disallow /level4/ -
Disallow /logotest/ -
Disallow /index_sjb.html -
Disallow /index_nw.html -
Disallow /index_s.html -
Disallow /index_sb.html -
Disallow /index_old.html -
Disallow /index_n06.html -
Disallow /index_n07.html -
Disallow /example -
Disallow /besmart/disabled/ -
Disallow /disabled/ -
Disallow /carnival/2* blocking old carnival pages with duplicate title tags
Allow /carnival/2024* allow current year
Allow /carnival/2*/images/ -
Disallow /campaign/ -
Disallow /catalog/archives/ old catalogs
Disallow /mtu_resources/banners/ -
Disallow /mtu_resources/cache/ -
Disallow /mtu_resources/php/ -
Allow /mtu_resources/php/home/components/* -
Allow /mtu_resources/php/ou/images/crop.php* -
Allow /mtu_resources/php/ou/images/news-crop.php* -
Allow /mtu_resources/php/ou/news/amp.php* -
Allow /mtu_resources/php/vanity/ -
Disallow /calendar/events.php -
Disallow /calendar/month.php -
Disallow /calendar/day.php -
Disallow /calendar/rss.php -
Disallow /calendar/print.php -
Disallow /calendar/search.php -
Disallow /calendar/login/ -
Disallow /home/ -
Disallow /admissions/event-registration/ -
Disallow /facultyupdate/ -
Allow /mtuldapweb/web_lookup/index.cgi -
Disallow /mtuldapweb/web_lookup/index.cgi*? -
Disallow /ou-* -
Disallow /housing/mymichigantech/* -
Disallow /.ldp/images/* -
Disallow /search/?q* -
Disallow /mtu_resources/archives/catalog/ blocking old undergraduate catalogs
Disallow /alert/homepage/* blocking individual Alert messages
Disallow /mtu_resources/full-news-2016.php* blocking RSS Feeds
Disallow /techalum/issue/* -
Disallow /techalum/oldarchives/* -
Disallow /ttoday/?issue=1* -
Disallow /ttoday/?issue=200* -
Disallow /ttoday/?issue=2010* -
Disallow /ttoday/?issue=2011* -
Disallow /ttoday/?issue=2012* -
Disallow /ttoday/?issue=2013* -
Disallow /ttoday/?issue=2014* -
Disallow /ttoday/?issue=2015* -
Disallow /ttoday/?issue=2016* -
Disallow /ttoday/?issue=2017* -
Disallow /ttoday/?issue=2018* -
Disallow /ttoday/?issue=2019* -
Disallow /ttoday/?issue=2020* -
Disallow /ttoday/?issue=2021* -
Disallow /ttoday/?issue=2022* -
Disallow /news/2005/* -
Disallow /news/2006/* -
Disallow /news/2007/* -
Disallow /news/2008/* -
Disallow /news/2009/* -
Disallow /news/2010/* -
Disallow /news/2011/* -
Disallow /news/2012/* -
Disallow /news/2013/* -
Disallow /news/2014/* -
Disallow /news/2015/* -
Disallow /news/2016/* -
Disallow /unscripted/2016/* -
Disallow /magazine/2015* -
Disallow /magazine/2016* -
Disallow /magazine/research/2015* -
Disallow /magazine/research/2016* -
Disallow *.xml -
Allow /news/2010/10/just-time-for-halloween-michigan-tech-students-solve-mystery-paulding-light.html -
Allow /news/2010/01/best-best-15-years-astronomy-picture-day.html -
Allow /news/2010/01/what-happened-haiti.html -
Allow /news/2010/09/hot-topic-earth-sciences-mantle-plume-model-siberian-traps.html -
Allow /news/2011/06/environmental-scientists-call-north-american-model-wildlife-conservation-flawed.html -
Allow /news/2012/03/wolf-population-isle-royale-drops-lowest-has-ever-been.html -
Allow /news/2012/03/what-should-done-disappearing-wolves-isle-royale.html -
Allow /news/2012/06/mystery-solved-wolves-drowned-old-mine-shaft-isle-royale-national-park.html -
Allow /news/2012/05/sex-its-good-thing-evolutionarily-speaking.html -
Allow /news/2012/10/spotting-trend-genes.html -
Allow /news/2012/04/clean-drinking-water-for-everyone.html -
Allow /news/2012/12/its-nothing-like-home-but-youll-like-here-recruiting-international-students.html -
Allow /news/2013/09/biggest-snowball-honor-returns-michigan-tech.html -
Allow /news/2013/05/most-scientists-agree-humans-causing-global-climate-change.html -
Allow /news/2013/06/beyond-silicon-transistors-without-semiconductors.html -
Allow /news/2013/11/scientists-build-low-cost-open-source-3d-metal-printer.html -
Allow /news/2013/11/ancient-copper-spear-point-special-exhibit-seaman-mineral-museum.html -
Allow /news/2013/03/isle-royale-wolves-fall-prey-inbreeding-problems.html -
Allow /news/2013/05/migration-patterns-reveal-much-us-population-research-finds.html -
Allow /news/2013/12/things-make-winter-epic-michigan-tech.html -
Allow /news/2013/04/zinc-perfect-material-for-bioabsorbable-stents.html -
Allow /news/2013/10/blacksmithing-problem-solving-art.html -
Allow /news/2014/02/what-do-do-now-family-members-brain-dead.html -
Allow /news/2014/09/black-new-green-biochar-beats-wood-cook-stoves.html -
Allow /news/2014/06/before-there-c-there-n-how-humans-derailed-nitrogen-cycle-trying-put-back-track.html -
Allow /news/2014/05/denso-underwrites-undergraduate-dynamometer-facility-michigan-tech.html -
Allow /news/2014/01/11-quintessential-sounds-winter-michigan-tech.html -
Allow /news/2014/01/search-time-travelers.html -
Allow /news/2014/08/michigan-tech-receives-nsf-grant-for-transmission-electron-microscope.html -
Allow /news/2015/10/shining-more-light-solar-panels.html -
Allow /news/2015/07/carbon-nanotube-speakers-play-music-heat.html -
Allow /news/2015/01/flashes-faster-than-light-spots-may-help-illuminate-astronomical-secrets.html -
Allow /news/2015/05/bioprinting-3d-looks-like-candy-could-regenerate-nerve-cells.html -
Allow /news/2015/03/tapping-into-mine-water-for-geothermal-energy.html -
Allow /news/2015/09/perfect-timing-for-fabrizio-zanello-watchword-patek.html -
Allow /news/2015/08/michigan-tech-top-public-university-state-for-mid-career-earnings-graduates.html -
Allow /news/2016/02/menominee-crack-geological-pop-up-structure.html -
Allow /news/2016/03/michigan-tech-ranks-2-state-for-value-education.html -
Allow /news/2016/05/leaving-electrical-grid-upper-peninsula.html -
Allow /news/2016/04/two-wolves-remain-isle-royale.html -
Allow /news/2016/02/memristors-making-new-generation-for-digital-memory-computation.html -
Allow /news/2016/12/driving-winter-wonderland.html -
Allow /news/2016/10/michigan-tech-ranks-high-globally-international-collaboration-engineering-materials-science.html -
Allow /news/2016/01/drone-catcher-robotic-falcon-can-capture-retrieve-renegade-drones.html -
Allow /news/2016/11/cloud-box-mixing-aerosols-turbulence.html -
Allow /news/2016/09/guide-seq-dna-duct-tape-mark-dna-damage.html -
Allow /unscripted/2016/10/grow-chinese-elm.html -
Allow /unscripted/2016/04/importance-restoring-wolf-predation-isle-royale.html -
Allow /unscripted/2016/09/geoheritage-stamping-through-history.html -
Allow /unscripted/2016/09/geoheritage-more-than-boulder.html -
Allow /unscripted/2016/06/purify-virus.html -
Allow /unscripted/2016/02/rust-ruin-preserving-industrial-artifacts-supercritical-fluid-treatments.html -
Allow /unscripted/2016/12/watch-what-happens-when-proteins-misfold.html -
Allow /magazine/2015-1/ -
Allow /magazine/2015-2/ -
Allow /magazine/2015-2/stories/douglass-houghton/ -
Allow /magazine/2016-1/ -
Allow /magazine/2016-2/ -
Allow /magazine/2016-2/stories/legend/ -
Allow /magazine/2016-1/stories/heart-husky/ -
Allow /magazine/2016-2/stories/company-town/ -
Allow /magazine/2016-1/stories/somethings-brewing/ -
Allow /magazine/research/2015/ -
Allow /magazine/research/2016/ -
Allow /magazine/research/2016/stories/peat-harvest/ -
Allow /mtu_resources/php/program-sorter/cache/sitemap.xml -
Allow /mtu_resources/php/ou/news/sitemap.php -

Other Records

Field Value
sitemap https://www.mtu.edu/sitemap.txt
sitemap https://www.mtu.edu/mtu_resources/php/ou/news/sitemap.php
sitemap https://www.mtu.edu/mtu_resources/php/program-sorter/cache/sitemap.xml

Comments

  • robots.txt for https://www.mtu.edu
  • Disallow: /planbudget/
  • Disallow: /parentnet/ # old parentnet directory
  • Disallow: /current/parentnet/archives/2000/ # old parentnet stories, blocked up to 5 years ago
  • Disallow: /current/parentnet/archives/2001/
  • Disallow: /current/parentnet/archives/2002/
  • Disallow: /current/parentnet/archives/2003/
  • Disallow: /alumni/contact/board/private/
  • Disallow: /search/*
  • News stories that had more than 100 views last year, that would otherwise be blocked
  • Unscripted stories that had more than 100 views last year, that would otherwise be blocked
  • Magazine stories that had more than 100 views last year, that would otherwise be blocked
  • Allow: /mtu_resources/php/ou/profiles/display-n.php*