sle.kit.edu
robots.txt

Robots Exclusion Standard data for sle.kit.edu

Resource Scan

Scan Details

Site Domain sle.kit.edu
Base Domain kit.edu
Scan Status Ok
Last Scan2025-07-04T18:50:39+00:00
Next Scan 2025-07-18T18:50:39+00:00

Last Scan

Scanned2025-07-04T18:50:39+00:00
URL https://sle.kit.edu/robots.txt
Redirect https://www.sle.kit.edu/robots.txt
Redirect Domain www.sle.kit.edu
Redirect Base kit.edu
Domain IPs 141.3.129.226, 2a00:1398:b::8d03:81e2
Redirect IPs 141.3.129.226, 2a00:1398:b::8d03:81e2
Response IP 141.3.129.226
Found Yes
Hash 75fd65f8d5dab3a4d5fb08f0613a64f3e1cd97f4868f9b3e08f85551c0bba294
SimHash 2cf8e96ccbd3

Groups

*

Rule Path
Disallow /cgi-bin/

w3c-checklink

Rule Path
Disallow

Comments

  • http://www.robotstxt.org/wc/exclusion.html#robotstxt
  • http://validator.w3.org/docs/checklink.html#bot