lssu.edu
robots.txt

Robots Exclusion Standard data for lssu.edu

Resource Scan

Scan Details

Site Domain lssu.edu
Base Domain lssu.edu
Scan Status Ok
Last Scan2024-11-04T16:16:13+00:00
Next Scan 2024-12-04T16:16:13+00:00

Last Scan

Scanned2024-11-04T16:16:13+00:00
URL https://lssu.edu/robots.txt
Redirect https://www.lssu.edu/robots.txt
Redirect Domain www.lssu.edu
Redirect Base lssu.edu
Domain IPs 141.193.213.20, 141.193.213.21
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash e3ce673384b0e6771437e643698486e37126f1cb1f1531063d6ace1b512a1dae
SimHash e92098560fb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

semrushbot-sa

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.lssu.edu/sitemap_index.xml

Comments

  • Old
  • User-agent: *
  • Disallow: /wp-admin/
  • Disallow: /scholarshipday*
  • Allow: /wp-admin/admin-ajax.php