bme.gatech.edu
robots.txt

Robots Exclusion Standard data for bme.gatech.edu

Resource Scan

Scan Details

Site Domain bme.gatech.edu
Base Domain gatech.edu
Scan Status Ok
Last Scan2025-07-17T08:50:31+00:00
Next Scan 2025-08-16T08:50:31+00:00

Last Scan

Scanned2025-07-17T08:50:31+00:00
URL https://bme.gatech.edu/robots.txt
Domain IPs 130.207.49.15
Response IP 130.207.49.15
Found Yes
Hash f99479902f83e19c7d4c1d45614a5102e09e462b13e3f0c523594d12e62d9883
SimHash 9901f9411f9a

Groups

*

Rule Path
Allow sitemap.xml
Disallow /css/
Disallow /coulter/
Disallow /faculty-meetings/
Disallow /fonts/
Disallow /images/
Disallow /img/
Disallow /inc/
Disallow /includes/
Disallow /internal/
Disallow /jobs/
Disallow /js/
Disallow /picture_library/
Disallow /plek-stat/
Disallow /recruiting_system/
Disallow /salary/
Disallow /sec/
Disallow /test/
Disallow /bme/projected-lifecycle/
Disallow /bme/includes/
Disallow /bme/misc/
Disallow /bme/modules/
Disallow /bme/profiles/
Disallow /bme/scripts/
Disallow /bme/themes/
Disallow /bme/CHANGELOG.txt
Disallow /bme/cron.php
Disallow /bme/INSTALL.mysql.txt
Disallow /bme/INSTALL.pgsql.txt
Disallow /bme/INSTALL.sqlite.txt
Disallow /bme/install.php
Disallow /bme/INSTALL.txt
Disallow /bme/LICENSE.txt
Disallow /bme/MAINTAINERS.txt
Disallow /bme/update.php
Disallow /bme/UPGRADE.txt
Disallow /bme/xmlrpc.php
Disallow /bme/admin/
Disallow /bme/comment/reply/
Disallow /bme/filter/tips/
Disallow /bme/node/add/
Disallow /bme/search/
Disallow /bme/user/register/
Disallow /bme/user/password/
Disallow /bme/user/login/
Disallow /bme/user/logout/
Disallow /bme/?q=admin%2F
Disallow /bme/?q=comment%2Freply%2F
Disallow /bme/?q=filter%2Ftips%2F
Disallow /bme/?q=node%2Fadd%2F
Disallow /bme/?q=search%2F
Disallow /bme/?q=user%2Fpassword%2F
Disallow /bme/?q=user%2Fregister%2F
Disallow /bme/?q=user%2Flogin%2F
Disallow /bme/?q=user%2Flogout%2F

Comments

  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)