kslib.info
robots.txt
Robots Exclusion Standard data for kslib.info
Resource Scan
Scan Details
Site Domain | kslib.info |
Base Domain | kslib.info |
Scan Status | Ok |
Last Scan | 2024-09-26T23:04:08+00:00 |
Next Scan | 2024-10-03T23:04:08+00:00 |
Last Scan
Scanned | 2024-09-26T23:04:08+00:00 |
URL | http://kslib.info/robots.txt |
Redirect | https://library.ks.gov/robots.txt |
Redirect Domain | library.ks.gov |
Redirect Base | ks.gov |
Domain IPs | 209.17.116.163 |
Redirect IPs | 3.86.37.148, 34.194.39.199, 54.85.246.96, 54.88.35.99 |
Response IP | 54.85.246.96 |
Found | Yes |
Hash | 94fd0265b45a6bd2ff44edc9db4dce4e66087c62f2b1ce12c763481c57855007 |
SimHash | 1824cc01e781 |
Groups
*
Rule | Path |
---|---|
Disallow | /er.php |
Disallow | /err.php |
Disallow | /go.php |
Disallow | /friendly.php |
Disallow | /ld.php |
Disallow | /srch.php |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://library.ks.gov/sitemap.xml |