drexel.edu
robots.txt
Robots Exclusion Standard data for drexel.edu
Resource Scan
Scan Details
Site Domain | drexel.edu |
Base Domain | drexel.edu |
Scan Status | Ok |
Last Scan | 2025-03-20T15:30:42+00:00 |
Next Scan | 2025-04-19T15:30:42+00:00 |
Last Scan
Scanned | 2025-03-20T15:30:42+00:00 |
URL | https://drexel.edu/robots.txt |
Domain IPs | 144.118.67.10 |
Response IP | 144.118.67.10 |
Found | Yes |
Hash | c714d761c745e2e645af966169685eaf0954adaa81cd5c82aab7e22cd2ba8b43 |
SimHash | 8f30f868a922 |
Groups
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /*/search |
Disallow | /search/* |
Disallow | /*/search/* |
Disallow | /coas/search |
Disallow | /api/du/search |
Disallow | /siteSearch/ |
Disallow | /Search |
Disallow | /*/Search |
Disallow | /Search/* |
Disallow | /*/Search/* |
Disallow | /coas/Search |
Disallow | /api/du/Search |
Disallow | /SiteSearch/ |
Disallow | /SEARCH |
Disallow | /*/SEARCH |
Disallow | /SEARCH/* |
Disallow | /*/SEARCH/* |
Disallow | /coas/SEARCH |
Disallow | /api/du/SEARCH |
Disallow | /SITESEARCH/ |
Disallow | /sitecore |
Disallow | /Sitecore |
Disallow | /SITECORE |