lib.vt.edu
robots.txt

Robots Exclusion Standard data for lib.vt.edu

Resource Scan

Scan Details

Site Domain lib.vt.edu
Base Domain vt.edu
Scan Status Ok
Last Scan2024-05-30T18:29:47+00:00
Next Scan 2024-06-29T18:29:47+00:00

Last Scan

Scanned2024-05-30T18:29:47+00:00
URL https://lib.vt.edu/robots.txt
Redirect https://lib.vt.edu/content/dam/lib_vt_edu/robots.txt
Domain IPs 198.82.215.14, 2607:b400:92:26:0:97:1e7:3947
Response IP 198.82.215.14
Found Yes
Hash a152638139d85982b13fd162680fa5bbc67bf68a6f260551a39d7bce485632af
SimHash 7b055c421492

Groups

*

Rule Path
Disallow /cdrs/
Disallow /find/netlibrary/
Disallow /images/
Disallow /innerlib/
Disallow /libqual/
Disallow /rms/
Disallow /services/
Disallow /spotlight/
Disallow /subjects/

Other Records

Field Value
sitemap https://lib.vt.edu/sitemap.xml