lickingcounty.gov
robots.txt

Robots Exclusion Standard data for lickingcounty.gov

Resource Scan

Scan Details

Site Domain lickingcounty.gov
Base Domain lickingcounty.gov
Scan Status Ok
Last Scan2024-05-15T04:18:25+00:00
Next Scan 2024-06-14T04:18:25+00:00

Last Scan

Scanned2024-05-15T04:18:25+00:00
URL https://lickingcounty.gov/robots.txt
Domain IPs 172.65.90.20, 172.65.90.21, 172.65.90.22, 172.65.90.23, 2606:4700:78::90:0:140, 2606:4700:78::90:0:141, 2606:4700:78::90:0:142, 2606:4700:78::90:0:143
Response IP 172.65.90.23
Found Yes
Hash b516af1e772e45bd95d6879d364e05b9c0c537936700d57d6b47c35f011a8837
SimHash ef76251bd7be

Groups

*

Rule Path
Disallow /403.asp
Disallow /404.asp
Disallow /500.asp
Disallow /501.asp
Disallow /502.asp
Disallow /styles.asp
Disallow /vpn.asp
Disallow /test/
Disallow /training/
Disallow /users/
Disallow /widgets/
Disallow /Widget_Layouts/
Disallow /layouts/
Disallow /widget_layouts/
Disallow /test.asp
Disallow /styles_design.asp
Disallow /styles/
Disallow /services/
Disallow /*.js$
Disallow /*.css$
Disallow /*aspnet*/
Disallow /*private*/
Disallow /admin/
Disallow /aspnet*/
Disallow /civica/
Disallow /civicax/
Disallow /civicax/filebank/
Disallow /services/
Disallow /*trash*/
Disallow /custom/
Disallow /_cache/
Disallow /_trashcan/
Disallow /_blobs/
Disallow /admin/
Allow /civica/press/display.asp
Disallow /crm/
Disallow /custom/
Disallow /documents/
Disallow /dtSearch/
Disallow /faqs/
Disallow /flash/
Disallow /forms/
Disallow /forum/
Disallow /galleries/
Disallow /google_rfi/
Disallow /home_nav/
Disallow /infoguide/
Disallow /portal/
Disallow /webalizer/
Disallow /styles/
Disallow /inc/
Disallow /mockup/
Disallow /navdata/
Disallow /search/
Disallow /swfs/
Disallow /templates/
Disallow /ute/
Disallow groupcommon.asp
Disallow /img/
Disallow /training/

Comments

  • Please note: There are a lot of pages on this site, and there are
  • some misbehaved spiders out there that go _way_ too fast. If you're
  • irresponsible, your access to the site may be blocked.
  • Root pages
  • Staging and internal folders
  • Don't index javascripts or stylesheets
  • Don't index these folders
  • Updated 091009 to comply with WAC recommendation
  • END OF FILE