stmarytx.edu
robots.txt

Robots Exclusion Standard data for stmarytx.edu

Resource Scan

Scan Details

Site Domain stmarytx.edu
Base Domain stmarytx.edu
Scan Status Ok
Last Scan2024-09-07T16:21:05+00:00
Next Scan 2024-10-07T16:21:05+00:00

Last Scan

Scanned2024-09-07T16:21:05+00:00
URL https://stmarytx.edu/robots.txt
Redirect https://www.stmarytx.edu/robots.txt
Redirect Domain www.stmarytx.edu
Redirect Base stmarytx.edu
Domain IPs 54.175.71.212
Redirect IPs 54.175.71.212
Response IP 54.175.71.212
Found Yes
Hash 31789ba5c946331573dca5c32ab761fea234eee0ddd261439226b92a6470b183
SimHash 10011f4ccd56

Groups

rogerbot

Rule Path
Disallow /policies/
Disallow /about/events/?
Disallow /category/news/?
Disallow /category/news/page/

Other Records

Field Value
sitemap https://www.stmarytx.edu/sitemap_index.xml