app.lincoln.ne.gov
robots.txt

Robots Exclusion Standard data for app.lincoln.ne.gov

Resource Scan

Scan Details

Site Domain app.lincoln.ne.gov
Base Domain ne.gov
Scan Status Ok
Last Scan2024-11-03T08:26:52+00:00
Next Scan 2024-12-03T08:26:52+00:00

Last Scan

Scanned2024-11-03T08:26:52+00:00
URL https://app.lincoln.ne.gov/robots.txt
Domain IPs 199.48.10.69
Response IP 199.48.10.69
Found Yes
Hash deca2f87eda5038cce8378de6b0ef0b6969cec3138599a29e74b3d1c2ac07b8d
SimHash c0268ca621b3

Groups

gsa-crawler

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

enterprise

Rule Path
Disallow /

*

Rule Path
Disallow /gif/
Disallow /maps/
Disallow /asp/
Disallow /InterLinc/
Disallow /script/
Disallow /secure/
Disallow /city/mayor/test/
Disallow /city/pworks/test/
Disallow /template/
Disallow /aspx/cnty/crimcase/
Disallow /aspx/city/pats/
Disallow /city/art/
Disallow /city/attorn/
Disallow /city/build/
Disallow /city/council/
Disallow /city/donate/
Disallow /city/download/
Disallow /city/finance/
Disallow /city/fire/
Disallow /city/flood/
Disallow /city/health/
Disallow /city/hipaa/
Disallow /city/hr/
Disallow /city/kidsJPA/
Disallow /city/library/
Disallow /city/ltu/
Disallow /city/mayor/
Disallow /city/parks/
Disallow /city/person/
Disallow /city/plan/
Disallow /city/police/
Disallow /city/safety/
Disallow /city/uplnk/
Disallow /city/urban/
Disallow /city/web-training/
Disallow /main/
Disallow /both/
Disallow /mobile/

Comments

  • robots.txt for http://lincoln.ne.gov/
  • Canonize-host: www.lincoln.ne.gov