Log In Sign Up

tlu.edu
robots.txt

Robots Exclusion Standard data for tlu.edu

Resource Scan

Scan Details

Site Domain tlu.edu
Base Domain tlu.edu
Scan Status Ok
Last Scan2025-07-26T06:00:17+00:00
Next Scan 2025-08-02T06:00:17+00:00

Last Scan

Scanned2025-07-26T06:00:17+00:00
URL https://tlu.edu/robots.txt
Redirect https://www.tlu.edu/robots.txt
Redirect Domain www.tlu.edu
Redirect Base tlu.edu
Domain IPs 165.227.248.71
Redirect IPs 94.247.142.1
Response IP 94.247.142.1
Found Yes
Hash b386fe721a0e48a982ee352a68cadd1dbe5ac81f83a4b0852326684375df6058
SimHash 217019722537

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Back to top

Other Records

Field Value
sitemap https://www.tlu.edu/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.tlu.edu/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top