drexel.edu
robots.txt

Robots Exclusion Standard data for drexel.edu

Resource Scan

Scan Details

Site Domain drexel.edu
Base Domain drexel.edu
Scan Status Ok
Last Scan2025-03-20T15:30:42+00:00
Next Scan 2025-04-19T15:30:42+00:00

Last Scan

Scanned2025-03-20T15:30:42+00:00
URL https://drexel.edu/robots.txt
Domain IPs 144.118.67.10
Response IP 144.118.67.10
Found Yes
Hash c714d761c745e2e645af966169685eaf0954adaa81cd5c82aab7e22cd2ba8b43
SimHash 8f30f868a922

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /search
Disallow /*/search
Disallow /search/*
Disallow /*/search/*
Disallow /coas/search
Disallow /api/du/search
Disallow /siteSearch/
Disallow /Search
Disallow /*/Search
Disallow /Search/*
Disallow /*/Search/*
Disallow /coas/Search
Disallow /api/du/Search
Disallow /SiteSearch/
Disallow /SEARCH
Disallow /*/SEARCH
Disallow /SEARCH/*
Disallow /*/SEARCH/*
Disallow /coas/SEARCH
Disallow /api/du/SEARCH
Disallow /SITESEARCH/
Disallow /sitecore
Disallow /Sitecore
Disallow /SITECORE