agnesscott.edu
robots.txt

Robots Exclusion Standard data for agnesscott.edu

Resource Scan

Scan Details

Site Domain agnesscott.edu
Base Domain agnesscott.edu
Scan Status Ok
Last Scan2024-10-30T01:14:22+00:00
Next Scan 2024-11-29T01:14:22+00:00

Last Scan

Scanned2024-10-30T01:14:22+00:00
URL https://agnesscott.edu/robots.txt
Redirect https://www.agnesscott.edu/robots.txt
Redirect Domain www.agnesscott.edu
Redirect Base agnesscott.edu
Domain IPs 4.21.22.190
Redirect IPs 4.21.22.190
Response IP 4.21.22.190
Found Yes
Hash 853a524ad1426076ba38017d30d9c40cb9197b2d2314fe9c4717da57a34e7882
SimHash 78044acc8510

Groups

*

Rule Path
Disallow /_academicfiles/
Disallow /testing/

Other Records

Field Value
sitemap https://www.agnesscott.edu/sitemap.xml

Warnings

  • `noindex` is not a known field.
  • `request-rate` is not a known field.
  • `visit-time` is not a known field.