ct.gov
robots.txt

Robots Exclusion Standard data for ct.gov

Resource Scan

Scan Details

Site Domain ct.gov
Base Domain ct.gov
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-30T01:52:43+00:00
Next Scan 2024-12-29T01:52:43+00:00

Last Successful Scan

Scanned2023-11-13T01:50:40+00:00
URL https://ct.gov/robots.txt
Domain IPs 159.247.0.240
Response IP 159.247.0.240
Found Yes
Hash da5814c75f201dabaa51700e67038d0f600eb82edef0934e02fc789ab12de4f0
SimHash 61c5bf557be3

Groups

*

Rule Path
Disallow /adm/
Disallow /Admin/
Disallow /Admin_DSF/
Disallow /BulkMail_Admin/
Disallow /Chat/
Disallow /colors/
Disallow /CWP_Admin/
Disallow /cwp/ask/
Disallow /CWP_EditorMacros/
Disallow /CWP_Import/
Disallow /CWP_mover/
Disallow /dsf_chat/
Disallow /DSF_IPfilter/
Disallow /eAlerts_Admin/
Disallow /eRoute/
Disallow /Error_Admin/
Disallow /eWebEditPro/
Disallow /governorrowland/
Disallow /governorrell/
Disallow /guestaccount/
Disallow /guestaccount/login/
Disallow /guestaccount/registration_form/
Disallow /Help_Admin/
Disallow /iCal_Admin/
Disallow /iCal_Attachments/
Disallow /iCal_StyleWiz/
Disallow /ltgovksullivan/
Disallow /ltgovmfedele/
Disallow /*pp%3D12%26n%3D1
Disallow /*pm%3D1
Disallow /tx/
Disallow /Media_Admin/
Disallow /MsgBoard_Admin/
Disallow /Nav_Admin/
Disallow /Page_Importer/
Disallow /Polls_admin/
Disallow /PPT_Logger/
Disallow /PPT_Mailer/
Disallow /ProcessXML/
Disallow /RecentAdd_Admin/
Disallow /scratch_pad/
Disallow /SiteConfig/
Disallow /SiteCrypt/
Disallow /Site_Sync/
Disallow /SMS/
Disallow /Task/
Disallow /Taxonomy_admin/
Disallow /TemplateImport/
Disallow /ULogin/
Disallow /URL_Picker/
Disallow /User_Admin/
Disallow /WebForms_Admin/
Disallow /Widgets_User/
Disallow /Widgets_User_Admin/
Disallow /xDoc/
Disallow /XMLNavMove/
Disallow /XMLNavTest/
Disallow /XMLSurveyMove/
Disallow /XMLSurveySample/
Disallow /_borders/
Disallow /_private/
Disallow /_ScriptLibrary/
Disallow /dev/adm/
Disallow /dev/Admin/
Disallow /dev/Admin_DSF/
Disallow /dev/BulkMail_Admin/
Disallow /dev/Chat/
Disallow /dev/colors/
Disallow /dev/CWP_Admin/
Disallow /dev/CWP_EditorMacros/
Disallow /dev/CWP_Import/
Disallow /dev/CWP_mover/
Disallow /dev/dsf_chat/
Disallow /dev/DSF_IPfilter/
Disallow /dev/eAlerts_Admin/
Disallow /dev/eRoute/
Disallow /dev/Error_Admin/
Disallow /dev/eWebEditPro/
Disallow /dev/Help_Admin/
Disallow /dev/iCal_Admin/
Disallow /dev/iCal_Attachments/
Disallow /dev/iCal_StyleWiz/
Disallow /dev/Media_Admin/
Disallow /dev/MsgBoard_Admin/
Disallow /dev/Nav_Admin/
Disallow /dev/Page_Importer/
Disallow /dev/Polls_admin/
Disallow /dev/PPT_Logger/
Disallow /dev/PPT_Mailer/
Disallow /dev/ProcessXML/
Disallow /dev/RecentAdd_Admin/
Disallow /dev/scratch_pad/
Disallow /dev/SiteConfig/
Disallow /dev/SiteCrypt/
Disallow /dev/Site_Sync/
Disallow /dev/SMS/
Disallow /dev/Task/
Disallow /dev/Taxonomy_admin/
Disallow /dev/TemplateImport/
Disallow /dev/ULogin/
Disallow /dev/URL_Picker/
Disallow /dev/User_Admin/
Disallow /dev/WebForms_Admin/
Disallow /dev/Widgets_User/
Disallow /dev/Widgets_User_Admin/
Disallow /dev/xDoc/
Disallow /dev/XMLNavMove/
Disallow /dev/XMLNavTest/
Disallow /dev/XMLSurveyMove/
Disallow /dev/XMLSurveySample/
Disallow /dev/_borders/
Disallow /dev/_private/
Disallow /dev/_ScriptLibrary/
Disallow /insidedep/lib/insidedep/
Disallow /cct
Disallow /ctbrownfields
Disallow /cpi/