web.wsu.edu
robots.txt

Robots Exclusion Standard data for web.wsu.edu

Resource Scan

Scan Details

Site Domain web.wsu.edu
Base Domain wsu.edu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-31T04:51:28+00:00
Next Scan 2025-10-29T04:51:28+00:00

Last Successful Scan

Scanned2024-09-12T04:29:56+00:00
URL https://web.wsu.edu/robots.txt
Domain IPs 15.197.242.34
Response IP 15.197.242.34
Found Yes
Hash 2442e340cf1bb279c081259600ed53bb27465077f13fa60a9023a38cd32adcb3
SimHash 490008228992

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://web.wsu.edu/wp-sitemap.xml
sitemap https://web.wsu.edu/sitemap.xml