www.ctsi.ufl.edu
robots.txt

Robots Exclusion Standard data for www.ctsi.ufl.edu

Resource Scan

Scan Details

Site Domain www.ctsi.ufl.edu
Base Domain ufl.edu
Scan Status Ok
Last Scan2025-08-25T08:18:36+00:00
Next Scan 2025-09-24T08:18:36+00:00

Last Scan

Scanned2025-08-25T08:18:36+00:00
URL https://www.ctsi.ufl.edu/robots.txt
Domain IPs 159.178.62.48
Response IP 159.178.62.48
Found Yes
Hash 8d51c177b017ce1b3db232e1ac514183360d102f7b5f015cb3e85d0e5eeafdaf
SimHash 731716a2b8c1

Groups

claudebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

*

Rule Path
Disallow /wordpress/wp-admin
Disallow /wordpress/wp-includes
Disallow /wordpress/wp-login.php
Disallow /wp-content/plugins
Disallow /wp-content/themes
Disallow /wp-content/cache
Disallow /trackback
Disallow /comments
Disallow /category/*/page
Disallow /full-calendar
Disallow /embed
Disallow /*?*p=
Disallow /*?*website=
Disallow /*?*action=
Allow /wp-content/plugins/**/*.js
Allow /wp-content/plugins/**/*.css
Allow /wp-content/plugins/**/*.jpeg
Allow /wp-content/plugins/**/*.jpg
Allow /wp-content/plugins/**/*.svg
Allow /wp-content/plugins/**/*.png
Allow /wp-content/plugins/**/*.gif
Allow /wp-content/themes/**/*.js
Allow /wp-content/themes/**/*.css
Allow /wp-content/themes/**/*.jpeg
Allow /wp-content/themes/**/*.jpg
Allow /wp-content/themes/**/*.svg
Allow /wp-content/themes/**/*.png
Allow /wp-content/themes/**/*.gif

Other Records

Field Value
sitemap https://www.ctsi.ufl.edu/wp-sitemap.xml