cuttingclub.cc
robots.txt
Robots Exclusion Standard data for cuttingclub.cc
Resource Scan
Scan Details
| Site Domain | cuttingclub.cc |
| Base Domain | cuttingclub.cc |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-09-05T14:36:28+00:00 |
| Next Scan | 2024-11-04T14:36:28+00:00 |
Last Successful Scan
| Scanned | 2024-06-15T14:34:33+00:00 |
| URL | http://cuttingclub.cc/robots.txt |
| Redirect | http://www.cuttingclub.cc/robots.txt |
| Redirect Domain | www.cuttingclub.cc |
| Redirect Base | cuttingclub.cc |
| Domain IPs | 109.236.87.12 |
| Redirect IPs | 109.236.87.12 |
| Response IP | 109.236.87.12 |
| Found | Yes |
| Hash | 4ea31b5512a01301970930a862af1407a90548890ab6521d27e0114cb4c3783a |
| SimHash | 731f5343c9e5 |
Groups
ahrefsbot
aqua_products
asterias
b2w/0.1
backdoorbot/1.0
baiduspider
blowfish/1.0
bookmark search tool
botalot
builtbottough
bullseye/1.0
bunnyslippers
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
compspybot
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
curious george
cybeye.com
daumoa
discobot
dittospyder
doc
docomo
download ninja
duggmirror
emailcollector
emailsiphon
emailwolf
erocrawler
exb language crawler
extractorpro
ezooms
fairad client
fast
fetch
flaming attackbot
flamingo_searchengine
foobot
gaisbot
genieo
getright/4.2
grub
grub-client
gsa-crawler
harvest/1.5
hloader
httplib
httrack
humanlinks
infonavirobot
iron33/1.0.2
jennybot
k2spider
kenjin spider
keyword density/0.9
larbin
lexibot
lexxebot
libcrawl
libweb/clshttp
libwww
linkdex
linkextractorpro
linko
linkscan/8.1a unix
linkwalker
lnspiderguy
looksmart
lwnutch
lwp-trivial
lwp-trivial/1.34
magpie-crawler
mata hari
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
moget
moget/2.1
mozilla/4.0 (compatible; bullseye; windows 95)
ms search 4.0 robot
msiecrawler
netants
netmechanic
nicerspro
npbot
nutch
offline explorer
openbot
openfind
openfind data gathere
openwebindex
oracle ultra search
perman
propowerbot/2.14
prowebwalker
psbot
python-urllib
queryn metasearch
radiation retriever 1.1
rediffnewsbot
repomonkey
repomonkey bait & tackle/v1.01
repparser
rma
rogerbot
scanmine
scoutjet
screaming frog seo spider
searchpreview
seoengworldbot
seznambot
shopwiki
showyoubot
sindice-site-manager
sitecheck.internetseer.com
siteexplorer
sitesnagger
sogou
sogou spider
sosospider
spankbot
spanner
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
ubicrawler
url control
url_spider_pro
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webenhancer
webmasterworldforumbot
webreaper
websauger
website quester
webster pro
webstripper
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
wocbot
woriobot
www-collector-e
xenu
xenu's
xenu's link sleuth 1.1c
yacybot
yandex
yeti
yolinkbot
youdaobot
zao
zealbot
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
adidxbot
ask.com
bingbot
duckduckbot
googlebot
ia_archiver
ia_archiver/1.6
msnbot
slurp
teoma
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /adultcheck/ |
| Disallow | /BAV/ |
| Disallow | /cclub/ |
| Disallow | /cgi-bin/ |
| Disallow | /cstars/ |
| Disallow | /drstory/ |
| Disallow | /erstory/ |
| Disallow | /fonts/ |
| Disallow | /fpdf/ |
| Disallow | /functions/ |
| Disallow | /galerie/ |
| Disallow | /geodb/ |
| Disallow | /geoip/ |
| Disallow | /marc/ |
| Disallow | /members/ |
| Disallow | /mestory/ |
| Disallow | /newscripts/ |
| Disallow | /newsmail/ |
| Disallow | /player/ |
| Disallow | /postkartenvorlage/ |
| Disallow | /scripts/ |
| Disallow | /shop/ |
| Disallow | /static/ |
| Disallow | /test/ |
| Disallow | /testVideo/ |
| Disallow | /updater/ |
| Disallow | /videos/ |
| Disallow | /office_profil.php |
| Disallow | /office_profil_en.php |
| Disallow | /office_sw.php |
| Disallow | /office_sw_en.php |
| Disallow | /anzeigenticker.php |
| Disallow | /anzeigenticker_en.php |
| Disallow | /anzeigenticker2.php |
| Disallow | /anzeigenticker2_en.php |
| Disallow | /nav_anzeigenticker.php |
| Disallow | /nav_anzeigenticker_en.php |
| Disallow | /nav_links.php |
| Disallow | /nav_links_en.php |
| Disallow | /nav_onlineuser.php |
| Disallow | /nav_onlineuser_en.php |
| Disallow | /nav_iframe2.php |
| Disallow | /nav_iframe2_en.php |
| Disallow | /umfrage2.php |
| Disallow | /umfrage2_en.php |
| Disallow | /*?id$ |
| Disallow | /*?lanswitch=1$ |
| Disallow | /*?link$ |
| Disallow | /*?ccsession$ |
| Disallow | /*.pdf$ |
| Disallow | /*.zip$ |
| Disallow | /*.tar.gz$ |
Warnings
- 3 invalid lines.
Comments