brownschool.wustl.edu
robots.txt

Robots Exclusion Standard data for brownschool.wustl.edu

Resource Scan

Scan Details

Site Domain brownschool.wustl.edu
Base Domain wustl.edu
Scan Status Ok
Last Scan2025-03-14T11:55:26+00:00
Next Scan 2025-04-13T11:55:26+00:00

Last Scan

Scanned2025-03-14T11:55:26+00:00
URL https://brownschool.wustl.edu/robots.txt
Redirect https://brownschool.washu.edu/robots.txt
Redirect Domain brownschool.washu.edu
Redirect Base washu.edu
Domain IPs 128.252.146.52
Redirect IPs 128.252.146.63
Response IP 128.252.146.63
Found Yes
Hash 7adba84a1ed2280977084c79c6679adcb3b4df1a02837713dc596b3423c449de
SimHash 2a0dca008992

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Allow /

etaospider

Rule Path
Disallow /

ccbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://brownschool.washu.edu/sitemap.xml
sitemap https://brownschool.washu.edu/sitemap.rss