chicagocityonline.com
robots.txt

Robots Exclusion Standard data for chicagocityonline.com

Resource Scan

Scan Details

Site Domain chicagocityonline.com
Base Domain chicagocityonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-22T11:47:55+00:00
Next Scan 2026-01-20T11:47:55+00:00

Last Successful Scan

Scanned2023-01-01T17:33:03+00:00
URL https://chicagocityonline.com/robots.txt
Domain IPs 162.241.148.33
Response IP 162.241.148.33
Found Yes
Hash cd54e0a61b21fe00d14e48cd782739c3aaab4b46966e7dd679fafb91832077c3
SimHash b0fb72a04bd5

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /images/
Disallow /support/

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

webauto

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

psbot

Rule Path
Disallow /

picpirate

Rule Path
Disallow /

picturestealer

Rule Path
Disallow /

picture

Rule Path
Disallow /

picturepirate

Rule Path
Disallow /

picturegrabber

Rule Path
Disallow /

picgrabber

Rule Path
Disallow /

website copier

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

httrack website copier/3.x

Rule Path
Disallow /

httrack website copier/3.x [xr&co'2003]

Rule Path
Disallow /

webstripper/2.59

Rule Path
Disallow /