mcmaster.ca
robots.txt
Robots Exclusion Standard data for mcmaster.ca
Resource Scan
Scan Details
Site Domain | mcmaster.ca |
Base Domain | mcmaster.ca |
Scan Status | Ok |
Last Scan | 2024-10-27T21:06:39+00:00 |
Next Scan | 2024-11-26T21:06:39+00:00 |
Last Scan
Scanned | 2024-10-27T21:06:39+00:00 |
URL | https://mcmaster.ca/robots.txt |
Domain IPs | 130.113.64.30 |
Response IP | 130.113.64.30 |
Found | Yes |
Hash | 33db4d4de2f6e4ee116ad745e49bd86517d4f9279c984089d093ecd87276228b |
SimHash | 687bbd8a6632 |
Groups
*
Rule | Path |
---|---|
Disallow | /busstrike/ |
Disallow | /cgi-bin/ |
Disallow | /inabisbin/ |
Disallow | /extras/ |
Disallow | /counter/ |
Disallow | /crsreg/ |
Disallow | /develop/ |
Disallow | /events/ |
Disallow | /eventsbkp/ |
Disallow | /guest/ |
Disallow | /guest-demo/ |
Disallow | /mail_results/ |
Disallow | /mcsearch/ |
Disallow | /netscapeConfig/ |
Disallow | /NetTracker/ |
Disallow | /nscal/ |
Disallow | /search/ |
Disallow | /search1/ |
Disallow | /regadmin/ |
Disallow | /regform/ |
Disallow | /searchmac/ |
Disallow | /stats/ |
Disallow | /verify_links/ |
Disallow | /webph/ |
Disallow | /purchase/misc/ |
Disallow | /ua/misc/ |
Disallow | /cis/regform/ |
Disallow | /CFIDE/ |
Disallow | /cis/projects/ |
Disallow | /usage/ |
Disallow | /emplibrary/ |
Disallow | /empower/ |
Disallow | /empsessions/ |
Disallow | /campaign_removed_UTSES-2651/ |
Disallow | /respectfulcommunity/ |
Disallow | /mosaic_removed_HMPS-7192/ |
Comments