www.veteranshealthlibrary.va.gov
robots.txt

Robots Exclusion Standard data for www.veteranshealthlibrary.va.gov

Resource Scan

Scan Details

Site Domain www.veteranshealthlibrary.va.gov
Base Domain va.gov
Scan Status Ok
Last Scan2025-03-09T12:16:18+00:00
Next Scan 2025-03-23T12:16:18+00:00

Last Scan

Scanned2025-03-09T12:16:18+00:00
URL https://www.veteranshealthlibrary.va.gov/robots.txt
Domain IPs 152.131.96.18, 2600:8010:0:28::28:18
Response IP 152.130.96.18
Found Yes
Hash a861009e29b52dd60af1808c0f39125a771a62ea3e355e4c44eb1f58a50952c0
SimHash 681e5cb08791

Groups

usasearch
googlebot
bingbot
slurp

Rule Path
Disallow /Admin/
Disallow /Search/

Other Records

Field Value
crawl-delay 2

*
amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.veteranshealthlibrary.va.gov/sitemap.xml