strayer.edu
robots.txt

Robots Exclusion Standard data for strayer.edu

Resource Scan

Scan Details

Site Domain strayer.edu
Base Domain strayer.edu
Scan Status Ok
Last Scan2024-11-05T13:38:39+00:00
Next Scan 2024-12-05T13:38:39+00:00

Last Scan

Scanned2024-11-05T13:38:39+00:00
URL https://strayer.edu/robots.txt
Redirect https://www.strayer.edu/robots.txt
Redirect Domain www.strayer.edu
Redirect Base strayer.edu
Domain IPs 104.18.26.125, 104.18.27.125, 2606:4700::6812:1a7d, 2606:4700::6812:1b7d
Redirect IPs 104.18.26.125, 104.18.27.125, 2606:4700::6812:1a7d, 2606:4700::6812:1b7d
Response IP 104.18.26.125
Found Yes
Hash d0f25c03179ac63a1a76b4e375522afdc0ef761f8cacfa34def88859769dcc72
SimHash 4b07b874c190

Groups

atomz/1.0

Rule Path
Disallow

gsa-crawler

Rule Path
Disallow

*

Rule Path
Disallow /bin/
Disallow /css/
Disallow /errors/
Disallow /partner/
Disallow /portal/
Disallow /Portal/
Disallow /PORTAL/
Disallow /portal/learner/
Disallow /Portal/Learner/
Disallow /PORTAL/LEARNER/
Disallow /Portal/Login/
Disallow /portal/login/
Disallow /ptnr/
Disallow /search/
Disallow /content/strayer-shared-content/
Disallow /content/
Allow /content/dam/
Disallow /career-guides/
Disallow /district-solutions/
Disallow /modals/
Disallow /content/experience-fragments/

adsbot-google
adsbot-google-mobile
adidxbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.strayer.edu/sitemap.xml