health.wvu.edu
robots.txt

Robots Exclusion Standard data for health.wvu.edu

Resource Scan

Scan Details

Site Domain health.wvu.edu
Base Domain wvu.edu
Scan Status Ok
Last Scan2024-11-09T21:40:29+00:00
Next Scan 2024-12-09T21:40:29+00:00

Last Scan

Scanned2024-11-09T21:40:29+00:00
URL https://health.wvu.edu/robots.txt
Domain IPs 157.182.99.98
Response IP 157.182.99.98
Found Yes
Hash 8515425caec0a8c50c39b4570b74dfbe4d0d37f064051a879c0f36f2f11244bc
SimHash e90c8a20cb92

Groups

*

Rule Path
Allow /

gsa-crawler

Rule Path
Disallow /news/story

Other Records

Field Value
sitemap http://www.hsc.wvu.edu/utilities/sitemap