Log In Sign Up

wustl.edu
robots.txt

Robots Exclusion Standard data for wustl.edu

Resource Scan

Scan Details

Site Domain wustl.edu
Base Domain wustl.edu
Scan Status Ok
Last Scan2024-10-21T05:41:09+00:00
Next Scan 2024-11-20T05:41:09+00:00

Last Scan

Scanned2024-10-21T05:41:09+00:00
URL https://wustl.edu/robots.txt
Redirect https://washu.edu/robots.txt
Redirect Domain washu.edu
Redirect Base washu.edu
Domain IPs 23.185.0.3
Redirect IPs 23.185.0.3, 2620:12a:8000::3, 2620:12a:8001::3
Response IP 23.185.0.3
Found Yes
Hash ce5043efa027095908bddbac38bd72fa36c2681539e7bc0622260759d68724a6
SimHash 490008c0e5b3

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://washu.edu/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top