ssb-prod.ec.alaska.edu
robots.txt

Robots Exclusion Standard data for ssb-prod.ec.alaska.edu

Resource Scan

Scan Details

Site Domain ssb-prod.ec.alaska.edu
Base Domain alaska.edu
Scan Status Ok
Last Scan2024-11-03T08:15:58+00:00
Next Scan 2024-12-03T08:15:58+00:00

Last Scan

Scanned2024-11-03T08:15:58+00:00
URL https://ssb-prod.ec.alaska.edu/robots.txt
Domain IPs 52.24.55.145, 52.24.56.185
Response IP 52.24.55.145
Found Yes
Hash f1109cd303add565053b184afce89e9e27d2019c581440d8cf729989bb4e8164
SimHash ec1b9a3377d1

Groups

gsa-crawler

Rule Path
Allow /

*

Rule Path
Disallow /

Comments

  • UAOnline robots.txt
  • Audit Trail
  • 10/11/2016 sxjdm Configured to allow UA Search appliance.
  • Allow UA Search appliance
  • Disallow any other Search Appliance
  • Disallow specific pages that should not be indexed

Warnings

  • 4 invalid lines.