stthomas.edu
robots.txt

Robots Exclusion Standard data for stthomas.edu

Resource Scan

Scan Details

Site Domain stthomas.edu
Base Domain stthomas.edu
Scan Status Ok
Last Scan2026-01-22T17:42:28+00:00
Next Scan 2026-02-05T17:42:28+00:00

Last Scan

Scanned2026-01-22T17:42:28+00:00
URL https://stthomas.edu/robots.txt
Domain IPs 3.170.19.107, 3.170.19.26, 3.170.19.49, 3.170.19.96
Response IP 3.170.19.26
Found Yes
Hash f83b532789efb8cd7b22f38f6946f1563cc4a587dcefcf283fe3166bc15176b4
SimHash 4040d2504373

Groups

*

Rule Path
Allow /
Disallow /castor/