lonestar.edu
robots.txt

Robots Exclusion Standard data for lonestar.edu

Resource Scan

Scan Details

Site Domain lonestar.edu
Base Domain lonestar.edu
Scan Status Ok
Last Scan2026-03-05T03:13:54+00:00
Next Scan 2026-04-04T03:13:54+00:00

Last Scan

Scanned2026-03-05T03:13:54+00:00
URL https://lonestar.edu/robots.txt
Redirect https://www.lonestar.edu/robots.txt
Redirect Domain www.lonestar.edu
Redirect Base lonestar.edu
Domain IPs 216.7.255.117
Redirect IPs 216.7.255.117
Response IP 216.7.255.117
Found Yes
Hash 12ec418495e58db93066ce6dc17d4d8da80f6ca13961842bff73a1af8eb1c1e9
SimHash e595180069f4

Groups

*

Rule Path
Disallow /strategic-goals/
Disallow *.pdf
Disallow /emails/

googlebot

Rule Path
Disallow /news/kingwood-archives/
Disallow /departments/
Disallow /emails/

bingbot

Rule Path
Disallow /emails/

twitterbot

Rule Path
Disallow