theswisscollector.com
robots.txt
Robots Exclusion Standard data for theswisscollector.com
Resource Scan
Scan Details
| Site Domain | theswisscollector.com |
| Base Domain | theswisscollector.com |
| Scan Status | Ok |
| Last Scan | 2024-11-07T13:37:42+00:00 |
| Next Scan | 2024-12-07T13:37:42+00:00 |
Last Scan
| Scanned | 2024-11-07T13:37:42+00:00 |
| URL | https://theswisscollector.com/robots.txt |
| Domain IPs | 2001:1600:3:13:f816:3eff:fe08:89ed, 84.16.78.184 |
| Response IP | 84.16.78.184 |
| Found | Yes |
| Hash | cd3ad34900d90bf38e23d8821897c3700a72b8f0059a776b02396d1540d53417 |
| SimHash | b20a7048413f |
Groups
alphaseobot
alphaseobot-sa
baiduspider-favo
baiduspider-cpro
baiduspider-ads
baidu
baiduspider-news
baiduspider-video
baiduspider-image
baiduspider
blexbot
alexibot
alvinetspider
antenne hatena
apocalxexplorerbot
asterias
backdoorbot/1.0
bizinformation
black hole
blowfish/1.0
botalot
builtbottough
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
disco pump 3.1
dittospyder
dotbot
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
flamingo_searchengine
foobot
grapeshot
harvest/1.5
hloader
httplib
httrack
httrack 3.0
humanlinks
igentia
infonavirobot
jennybot
jikespider
kenjin spider
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lwp-trivial
lwp-trivial/1.34
mata hari
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
mlbot
moget
moget/2.1
ms search 4.0 robot
ms search 5.0 robot
naverbot
netants
netattache
netmechanic
nicerspro
offline explorer
openfind
openindexspider
propowerbot/2.14
prowebwalker
psbot
quepasacreep
queryn metasearch
repomonkey
rma
sightupbot
sitebot
sitesnagger
sitesucker
sogou web spider
sosospider
spankbot
spanner
speedy
suggybot
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
toscrawler
trendictionbot
true_robot
true_robot/1.0
turingos
turnitinbot
urlpouls
urly warning
vci
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
wget
wikiofeedbot
winhttrack
www-collector-e
xenu link sleuth/1.3.8
yacy
yandex
yrspider
zeus
zookabot
bytespider
like gecko
claudebot/1.0
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | */modules/*.css |
| Allow | */modules/*.js |
| Allow | */modules/*.png |
| Allow | */modules/*.jpg |
| Allow | /js/jquery/* |
| Disallow | /*?order= |
| Disallow | /*?tag= |
| Disallow | /*?id_currency= |
| Disallow | /*?search_query= |
| Disallow | /*?back= |
| Disallow | /*?n= |
| Disallow | /*%26order%3D |
| Disallow | /*%26tag%3D |
| Disallow | /*%26id_currency%3D |
| Disallow | /*%26search_query%3D |
| Disallow | /*%26back%3D |
| Disallow | /*%26n%3D |
| Disallow | /*controller%3Daddresses |
| Disallow | /*controller%3Daddress |
| Disallow | /*controller%3Dauthentication |
| Disallow | /*controller%3Dcart |
| Disallow | /*controller%3Ddiscount |
| Disallow | /*controller%3Dfooter |
| Disallow | /*controller%3Dget-file |
| Disallow | /*controller%3Dheader |
| Disallow | /*controller%3Dhistory |
| Disallow | /*controller%3Didentity |
| Disallow | /*controller%3Dimages.inc |
| Disallow | /*controller%3Dinit |
| Disallow | /*controller%3Dmy-account |
| Disallow | /*controller%3Dorder |
| Disallow | /*controller%3Dorder-slip |
| Disallow | /*controller%3Dorder-detail |
| Disallow | /*controller%3Dorder-follow |
| Disallow | /*controller%3Dorder-return |
| Disallow | /*controller%3Dorder-confirmation |
| Disallow | /*controller%3Dpagination |
| Disallow | /*controller%3Dpassword |
| Disallow | /*controller%3Dpdf-invoice |
| Disallow | /*controller%3Dpdf-order-return |
| Disallow | /*controller%3Dpdf-order-slip |
| Disallow | /*controller%3Dproduct-sort |
| Disallow | /*controller%3Dsearch |
| Disallow | /*controller%3Dstatistics |
| Disallow | /*controller%3Dattachment |
| Disallow | /*controller%3Dguest-tracking |
| Disallow | /app/ |
| Disallow | /cache/ |
| Disallow | /classes/ |
| Disallow | /config/ |
| Disallow | /controllers/ |
| Disallow | /download/ |
| Disallow | /js/ |
| Disallow | /localization/ |
| Disallow | /log/ |
| Disallow | /mails/ |
| Disallow | /modules/ |
| Disallow | /override/ |
| Disallow | /pdf/ |
| Disallow | /src/ |
| Disallow | /tools/ |
| Disallow | /translations/ |
| Disallow | /upload/ |
| Disallow | /var/ |
| Disallow | /vendor/ |
| Disallow | /webservice/ |
| Disallow | /fr/app/ |
| Disallow | /fr/cache/ |
| Disallow | /fr/classes/ |
| Disallow | /fr/config/ |
| Disallow | /fr/controllers/ |
| Disallow | /fr/download/ |
| Disallow | /fr/js/ |
| Disallow | /fr/localization/ |
| Disallow | /fr/log/ |
| Disallow | /fr/mails/ |
| Disallow | /fr/modules/ |
| Disallow | /fr/override/ |
| Disallow | /fr/pdf/ |
| Disallow | /fr/src/ |
| Disallow | /fr/tools/ |
| Disallow | /fr/translations/ |
| Disallow | /fr/upload/ |
| Disallow | /fr/var/ |
| Disallow | /fr/vendor/ |
| Disallow | /fr/webservice/ |
| Disallow | /de/app/ |
| Disallow | /de/cache/ |
| Disallow | /de/classes/ |
| Disallow | /de/config/ |
| Disallow | /de/controllers/ |
| Disallow | /de/download/ |
| Disallow | /de/js/ |
| Disallow | /de/localization/ |
| Disallow | /de/log/ |
| Disallow | /de/mails/ |
| Disallow | /de/modules/ |
| Disallow | /de/override/ |
| Disallow | /de/pdf/ |
| Disallow | /de/src/ |
| Disallow | /de/tools/ |
| Disallow | /de/translations/ |
| Disallow | /de/upload/ |
| Disallow | /de/var/ |
| Disallow | /de/vendor/ |
| Disallow | /de/webservice/ |
| Disallow | /it/app/ |
| Disallow | /it/cache/ |
| Disallow | /it/classes/ |
| Disallow | /it/config/ |
| Disallow | /it/controllers/ |
| Disallow | /it/download/ |
| Disallow | /it/js/ |
| Disallow | /it/localization/ |
| Disallow | /it/log/ |
| Disallow | /it/mails/ |
| Disallow | /it/modules/ |
| Disallow | /it/override/ |
| Disallow | /it/pdf/ |
| Disallow | /it/src/ |
| Disallow | /it/tools/ |
| Disallow | /it/translations/ |
| Disallow | /it/upload/ |
| Disallow | /it/var/ |
| Disallow | /it/vendor/ |
| Disallow | /it/webservice/ |
| Disallow | /*fr/password-recovery |
| Disallow | /*fr/address |
| Disallow | /*fr/addresses |
| Disallow | /*fr/login |
| Disallow | /*fr/cart |
| Disallow | /*fr/discount |
| Disallow | /*fr/order-history |
| Disallow | /*fr/identity |
| Disallow | /*fr/my-account |
| Disallow | /*fr/order-follow |
| Disallow | /*fr/credit-slip |
| Disallow | /*fr/order |
| Disallow | /*fr/search |
| Disallow | /*fr/guest-tracking |
| Disallow | /*fr/order-confirmation |
| Disallow | /*de/password-recovery |
| Disallow | /*de/address |
| Disallow | /*de/addresses |
| Disallow | /*de/login |
| Disallow | /*de/cart |
| Disallow | /*de/discount |
| Disallow | /*de/order-history |
| Disallow | /*de/identity |
| Disallow | /*de/my-account |
| Disallow | /*de/order-follow |
| Disallow | /*de/credit-slip |
| Disallow | /*de/order |
| Disallow | /*de/search |
| Disallow | /*de/guest-tracking |
| Disallow | /*de/order-confirmation |
| Disallow | /*it/password-recovery |
| Disallow | /*it/address |
| Disallow | /*it/addresses |
| Disallow | /*it/login |
| Disallow | /*it/cart |
| Disallow | /*it/discount |
| Disallow | /*it/order-history |
| Disallow | /*it/identity |
| Disallow | /*it/my-account |
| Disallow | /*it/order-follow |
| Disallow | /*it/credit-slip |
| Disallow | /*it/order |
| Disallow | /*it/search |
| Disallow | /*it/guest-tracking |
| Disallow | /*it/order-confirmation |
Warnings
- 1 invalid line.
Comments