jccny.org
robots.txt
Robots Exclusion Standard data for jccny.org
Resource Scan
Scan Details
| Site Domain | jccny.org |
| Base Domain | jccny.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-07-29T22:35:22+00:00 |
| Next Scan | 2024-10-27T22:35:22+00:00 |
Last Successful Scan
| Scanned | 2023-10-04T21:31:16+00:00 |
| URL | https://jccny.org/robots.txt |
| Domain IPs | 209.182.211.209 |
| Response IP | 209.182.211.209 |
| Found | Yes |
| Hash | 91b12274820fceb1895c2fe0e39577af659e4f2f249d180efa17567a3aac627a |
| SimHash | 5a587160d0ea |
Groups
ahrefsbot
alphabot
alphaseobot
baiduspider
bubing
easouspider
ezooms
yandexbot
mauibot
mj12bot
sitesucker
httrack
sistrix
sistrix crawler
sistrix
seokicks-robot
jobs.de-robot
unisterbot
dotbot
searchmetricsbot
surveybot
seodiver
spbot
wotbox
dotbot
meanpathbot
backlinkcrawler
magpie-crawler
obot
fr-crawler
blexbot
megaindex.ru
megaindex.com
cloudservermarketspider
trendictionbot
exabot
careerbot
lipperhey-kaus-australis
seoscanners.net
metajobbot
spiderbot
linkstats
jobboersebot
iccrawler
plista
domain re-animator bot
lipperhey-kaus-australis
turnitinbot
coccoc
um-ic
mindupbot
sg-orbiter
ccbot
qwantify
kraken
plukkie
safednsbot
haosouspider
rogerbot
openhosebot
screaming frog seo spider
thumbsniper
r6_commentreader
implisensebot
cliqzbot
aihitbot
trendictionbot
wbsearchbot
istellabot
edisterbot
discobot
huaweisymantecspider
jikespider
npbot
sogou spider
sosospider
yandex
nyu internet census
dnyzbot
semrushbot
psbot
the knowledge ai
sogou web spider
sogou
crawler.feedback
jakarta commons-httpclient
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /images |
| Disallow | /bbs |
| Disallow | /banners |
| Disallow | rotation.html |
Warnings
- 1 invalid line.