flcourts.org
robots.txt

Robots Exclusion Standard data for flcourts.org

Resource Scan

Scan Details

Site Domain flcourts.org
Base Domain flcourts.org
Scan Status Ok
Last Scan2024-04-22T18:43:46+00:00
Next Scan 2024-05-22T18:43:46+00:00

Last Scan

Scanned2024-04-22T18:43:46+00:00
URL https://flcourts.org/robots.txt
Redirect https://www.flcourts.gov/robots.txt
Redirect Domain www.flcourts.gov
Redirect Base flcourts.gov
Domain IPs 52.71.164.101
Redirect IPs 13.227.254.117, 13.227.254.52, 13.227.254.66, 13.227.254.96
Response IP 13.227.254.96
Found Yes
Hash 82c5c1857991a287b20cd1f2e3c323ca9a93233f4fdbb05859beab4e29ce569b
SimHash 6811d1c1c3f5

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

googlebot
bingbot
bingpreview
msnbot
slurp
duckduckbot
applebot
ia_archiver
facebookexternalhit
twitterbot
linkedinbot

Rule Path Comment
Allow / -
Disallow /admin/ -
Disallow /site_admin/ -
Disallow /search -
Disallow /search/ -
Disallow /content/search -
Disallow /content/advancedsearch -
Disallow /content/tipafriend -
Disallow /layout/set/print -
Disallow /rss -
Disallow /media/ -
Disallow /ezinfo/ -
Disallow /user/ -
Disallow /test-area/ -
Disallow /content/download/347260/file/11-404_JurisIni.pdf 11404

Comments

  • Disallow all
  • But allow only important bots