clayton.edu
robots.txt

Robots Exclusion Standard data for clayton.edu

Resource Scan

Scan Details

Site Domain clayton.edu
Base Domain clayton.edu
Scan Status Ok
Last Scan2025-08-28T10:08:21+00:00
Next Scan 2025-09-27T10:08:21+00:00

Last Scan

Scanned2025-08-28T10:08:21+00:00
URL https://clayton.edu/robots.txt
Domain IPs 3.209.26.193, 34.236.193.193, 52.73.2.219
Response IP 52.73.2.219
Found Yes
Hash 5e599b4377d4660c7013a5f355007358ae099cbea70310910c7206f3e0c6d846
SimHash ac04c8c48132

Groups

*

Rule Path
Disallow /site-archives/
Disallow /dev/
Disallow /admissions/dev/
Disallow /_resources/

Other Records

Field Value
sitemap https://www.clayton.edu/sitemap.xml