lib.vt.edu
robots.txt
Robots Exclusion Standard data for lib.vt.edu
Resource Scan
Scan Details
Site Domain | lib.vt.edu |
Base Domain | vt.edu |
Scan Status | Ok |
Last Scan | 2024-08-28T18:30:19+00:00 |
Next Scan | 2024-09-27T18:30:19+00:00 |
Last Scan
Scanned | 2024-08-28T18:30:19+00:00 |
URL | https://lib.vt.edu/robots.txt |
Redirect | https://lib.vt.edu/content/dam/lib_vt_edu/robots.txt |
Domain IPs | 198.82.215.14, 2607:b400:92:26:0:97:1e7:3947 |
Response IP | 198.82.215.14 |
Found | Yes |
Hash | a152638139d85982b13fd162680fa5bbc67bf68a6f260551a39d7bce485632af |
SimHash | 7b055c421492 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdrs/ |
Disallow | /find/netlibrary/ |
Disallow | /images/ |
Disallow | /innerlib/ |
Disallow | /libqual/ |
Disallow | /rms/ |
Disallow | /services/ |
Disallow | /spotlight/ |
Disallow | /subjects/ |
Other Records
Field | Value |
---|---|
sitemap | https://lib.vt.edu/sitemap.xml |