samueletoo.fr
robots.txt

Robots Exclusion Standard data for samueletoo.fr

Resource Scan

Scan Details

Site Domain samueletoo.fr
Base Domain samueletoo.fr
Scan Status Ok
Last Scan2024-11-13T21:10:49+00:00
Next Scan 2024-11-20T21:10:49+00:00

Last Scan

Scanned2024-11-13T21:10:49+00:00
URL https://samueletoo.fr/robots.txt
Redirect https://www.samueletoo.fr/robots.txt
Redirect Domain www.samueletoo.fr
Redirect Base samueletoo.fr
Domain IPs 91.234.194.249
Redirect IPs 91.234.194.249
Response IP 91.234.194.249
Found Yes
Hash e3c0d3b19d1f6f5e31cead48b6c7a99734fc576912e33fcb9cae073fefe4c892
SimHash 63c572ebe0aa

Groups

*

Rule Path
Disallow /*?
Disallow /?s=
Disallow */trackback
Disallow /blog/*/feed
Disallow /blog/*/feed/.*
Disallow /cgi-bin/
Disallow /*.js$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /wp-content/cache/
Disallow /author/.*
Disallow /wp-json/*
Allow /wp-content/uploads/
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Disallow /*?
Disallow /?s=
Disallow /cgi-bin/
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Allow *.js
Allow *.css
Disallow /wp-login.php
Disallow /wp-admin/
Disallow /author/.*
Disallow /wp-json/*
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/

ahrefs
ahrefs.com
ahrefsbot
ahrefsbot/2.0
ahrefsbot/3.1
backlinkwatch
exabot
mj12bot
patatebot
rogerbot
screamingfrogseospider
searchpreview
siteauditbot
semrushbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot
semrushbot-coub
semrushbot-swa
yandex
yandexbot/3.0
abonti
aboundex
aboundexbot
acunetix
adbeat_bot
addthis
admantx
adscanner
advbot
afd-verbotsverfahren
aibot
aihitbot
aipbot
aitcsrobot/1.1
alexibot
alligator
allsubmitter
alphabot
alphaseobot
alphaseobot-sa
analyzebacklinks
anarchie
apexoo
aqua_products
arachnophilia
aranhabot
archive.org_bot
arquivo-web-crawler
aspider/0.09
aspseek
asterias
asterias
atraxsolutions
attach
audisto
audisto-essential
auresys/1.0
autoemailspider
awariorssbot
awariosmartbot
b2w/0.1
babya discoverer
backdoorbot
backdoorbot/1.0
backlink-ceck
backlink-check
backlink-check.de
backlinkcrawler
backrub/.
backstreet
backweb
bad bots
baiduspider
baiduspider/2.0
baiduspider-image
baiduspider-video
bandit
barkrowler
batchftp
battleztarbazinga
bbbike
bdcbot
bdfetch
becomebot
becomebot
begunadvertising
betabot
big brother
bigfoot
bitacle
bitlybot
bizbot003
bizbot04 kirk.overleaf.com
black hole
black.hole
blackboard
blackhole
blackwidow
blekkobot
blexbot
blow
blowfish
blowfish/1.0
blp_bbot
blp_bbot/0.1
boardreader
bolt
booglebot
bookmark search tool
bookmarksearchtool
botalot
botrighthere
brandprotect
brandwatch
bspider/1.0 libwww-perl/0.40
bubing
buckyohare
buddy
builtbottough
builtwith
bullseye
bullseye/1.0
bunnyslippers
buzzsumo
ca-crawler
cactvs chemistry spider
calculon
camontspider
careerbot
catchbot
catexplorador
cazoodlebot
ccbot
ccbot
ccbot/2.0
cegbfeieh
changedetection
checkbot
checkbot/x.xx lwp/5.x
checkmarknetwork/1.0
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
cheteam
chinaclaw
chlooe
cincraw/1.0
claritybot
cliqzbot
cloudmapping
cloudservermarketspider
cmscrawler
coccoc
coccocbot-web
cogentbot
cognitiveseo
collector
com.plumanalytics
combine/0.0
compspybot
conceptbot/0.3
copernic
copier
copyrightcheck
copyscape
cosmos
cosmos
cowbot/1.0
craftbot
crawl.sogou.com
crawler.feedback
crawler4j
crazywebcrawler
crazywebcrawler-spider
crescent
crescent internet
crescent internet toolpak http ole control v.1.0
crunchbot
cshttp
cukbot
curious
curiousgeorge
custo
cyberpatrol sitecat webbot
cyberspyder/2.1
databasedrivermysqli
datacha0s
datanyze
dataprovider
daum
daumoa
dblbot
deepcrawl
demandbase-bot
demon
der-bot
deskyobot
deskyobot/1.0
deusu
devil
deweb/1.01
dfbot1.0
diffbot
digincore
digitalpebble
diibot
dirbuster
disco
disco
disco pump 3.0
disco pump 3.2
discobot
discobot
discofinder
discoverybot
dispatch
dittospyder
dlvr.it
dnyzbot
doc
domainappender
domaincrawler
domainre-animatorbot
domainsigmacrawler
domainstatsbot
dotbot
dotbot
download demon
download demon/3.2.0.8
download demon/3.5.0.11
download ninja
download\demon
downloadwonder
dragonfly
drip
dsearch
dtsagent
dubaiindex
dumbot
dumbot
easydl
ebingbong
ecatch
ecatch/3.0
eccp/1.0
ecxi
eirgrabber
electricmonk
emailcollector
emailsiphon
emailsiphon
emailwolf
emailwolf
enigmabot
enterprise_search
enterprise_search
enterprise_search/1.0
envolk
erocrawler
es
evc-batch
evc-batch/2.0
evil
exabot
expertsearchspider
explorersearch
express webpictures
express\webpictures
expresswebpictures
extlinksbot
extractor
extractorpro
extremepicturefinder
eyenetie
ezooms
ezooms robot
ezoomsrobot
facebookscraper
fairad client
fairad client
fairadclient
fasterfox
fatbot
fdm
felixide/1.0
femtosearchbot
fetch
fhscan
fido/0.9 harvest/1.4.pl2
filibot/1.0
fimap
findlinksrobot
findxbot
firefox/7.0
fish-search-robot
flaming attackbot
flamingattackbot
flashget
flashget webwasher 3.2
flunky
foobot
fr-crawler
freecrawl
freefind
freeuploader
frontpage
frontpage [nc,or]
fyberspider
fyrebot
gaisbot
galaxybot
garlikcrawler
gcreep/1.0
genieo
genieo/1.0
germcrawler
getintent
getright
getright/2.11
getright/3.1
getright/3.2
getright/3.3
getright/3.3.3
getright/3.3.4
getright/4.0.0
getright/4.1.0
getright/4.1.1
getright/4.1.2
getright/4.2
getright/4.2b
getright/4.2c
getright/4.3
getright/4.5
getright/4.5a
getright/4.5b
getright/4.5b1
getright/4.5b2
getright/4.5b3
getright/4.5b6
getright/4.5b7
getright/4.5c
getright/4.5d
getright/4.5e
getright/5.0beta1
getright/5.0beta2
geturl.rexx v1.05
getweb
getweb!
gigablast
gigabot
g-i-g-a-b-o-t
gloomarbot
glutenfreecrawler/1.0
go!zilla
go-ahead-got-it
golem/1.1
gosign-security-crawler
gotit
gozilla
grabber
grabnet
grafula
grapefx
grapeshot
grapeshotcrawler
gridbot
gromit/1.0
grouphigh
grouphigh/1.0
grub
grub
grub-client
grub-client
gt: : www
haansoft
haosouspider
happyfunbot
harvest
harvest/1.5
hatena antenna
hatena antenna
havij
hazel's ferret web hopper
headmasterseo
heritrix
hloader
hloader
hmhkki/0.2
hmview
htmlparser
http: //site.ru
http: : lite
httplib
httrack
httrack [nc,or]
httrack 3.0
huaweisymantecspider
huaweisymantecspider
hubspotcrawler1.0
hubspotlinkscrawler1.0
humanlinks
humanlinks
hybridbot
hypercrawl
hypestat
ia_archiver
ias_crawler
iblog
iccrawler
iccrawler-icjobs
idbot
idmarch
id-search
ilsebot
image stripper
image sucker
image\stripper
image\sucker
imagefetch
imagesucker
implisensebot
inagist.com url crawler
incywincy/1.0b1
indeedbot
indy library
indy library [nc,or]
indy\library
indylibrary
infonavirobot
informant
infotekies
ingrid/0.1
instabid
intelliseek
interget
internet ninja
internet ninja 4.0
internet ninja 5.0
internet ninja 6.0
internet\ninja
internetninja
internetseer
internetvistamonitor
ips-agent
iria
irlbot
iron33/1.0.2
iskanie
israelisearch/1.0
istellabot
istellabot/1.01.18
istellabot/1.01.18+
istellabot/1.10.2+
iti spider
iwebtool
jamesbot
jbrofuzz
jennybot
jetbot
jetbot
jetbot/1.0
jetcar
jetty
jikespider
jobboersebot
jobdiggerspider
jobs.de-robot
joc web spider
joc\web\spider
jocwebspider
joomla
jorgee
jubiirobot
jumpstation
justview
jyxobot
k2spider
kalooga
katipo/1.0
kenjin spider
kenjin spider
kenjin.spider
kenjinspider
keyword density/0.9
keyword density/0.9
keyword.density
keyworddensity
keyworddensity/0.9
kit-fireball/2.0 libwww/5.0a
kozmosbot
kraken
kwfinder
labelgrab/1.1
lanshanbot
larbin
leechftp
leechget
leikibot
lexibot
lftp
libcurl
libweb
libweb/clshttp
libwhisker
libwww
lightspeedsystems
likse
linguee
linkdexbot
linkextractorpro
linkextractorpro
linklooker
linkminer
linko
linkpad
linkpadbot
linkresearchtools
linkscan
linkscan/8.1a unix
linkscan/8.1a unix
linkscan/8.1a.unix
linkscan/8.1aunix
linksmanager
linkstats
linkwalker
linkwalker
linqiametadatadownloaderbot
linqiarssbot
linqiascrapebot
lipperhey
lipperhey-kaus-australis
lipperheyspider
litemage_walker
livelap
lmspider
lnspiderguy
looksmart
lssrocket
lssrocketcrawler
ltx71
ltx71+-+
lwp: : simple
lwp-request
lwp-trivial
lwp-trivial/1.34
magnet
mag-net
magpie
magpie-crawler
mail.ru
mail.ru_bot
majestic12
majestic-12
majesticseo
majestic-seo
mappy
markmonitor
markwatch
mass downloader
mass downloader/2.2
mass\downloader
masscan
massdownloader
mata hari
mata hari
mata.hari
matahari
mauibot
mbcrawler
meanpathbot
mediafox/x.y
mediatoolkitbot
mediawords
megaindex.com
megaindex.ru
megaindex.ru2.0
merzscope
metagopher
metajobbot
metauri
mfc_tear_sample
microsoft url control
microsoft.url
microsoft.url.control
microsoftdataaccess
microsofturlcontrol
midown tool
midown\tool
midowntool
miixpc
miixpc/4.2
mindupbot
mister pix
mister pix
mister pix ii 2.01
mister pix ii 2.02a
mister pix version.dll
mister.pix
mister\pix
misterpix
moget
moget/2.1
mojeek
mojeekbot
momspider/1.00 libwww-perl/0.40
monitorbacklinks
moonsearch
motor/0.2
mozilla/4.0 (compatible; bullseye; windows 95)
mr.4x3
mr.4x3powered
msfrontpage
msiecrawler
msrabot
muhstik-scan
musobot
nameintelligence
nameprotect
naver
naver
navroad
nbot
nearsite
needle
neofonie
neosciocrawler
nerdybot
nessus
net vampire
net vampire/3.0
net\vampire
netants
netants/1.10
netants/1.23
netants/1.24
netants/1.25
netcarta cyberpilot pro
netcraft
netcraftsurveyagent
netestate
netestate ne crawler
netestatenecrawler
netlyzer
netmechanic
netpeakspiderbot
netscoop/1.0 libwww/5.0a
netseer
netspider
nettrack
netvampire
netvibes
netzip
netzip downloader 1.0 win32(nov 12 1998)
netzip-downloader/1.0.62 (win32; dec 7 1998)
netzippy+(http://www.innerprise.net/usp-spider.asp)
nextgensearchbot
nhsewalker/3.0
nibbler
nicerspro
niki-bot
nikto
nimblecrawler
nimbostratus
ninja
nmap
nomad-v2.x
npbot
npbot
nutch
obot
obot/2.3.1
occam/1.0
octopus
offline explorer
offline explorer
offline navigator
offline.explorer
offline\explorer
offline\navigator
offlineexplorer
offlinenavigator
ogspider
oncrawl
open text site crawler v1.0
openbot
openfind
openfind data gathere
openfind data gathere
openfind data gatherer
openfinddatagatherer
openhosebot
openindexspider
openlinkprofiler
openvas
oracle ultra search
oracle ultra search
orangebot
orangespider
outclicksbot
outfoxbot
pageanalyzer
pagegrabber
pagescorer
pandalytics
pandalytics/1.0
panscient
panscient.com
papa foto
papa\foto
papafoto
pavuk
pavuk
pcbrowser
pecl: : http
peoplepal
perl lwp
perman
perman
petalbot
pgp-ka/1.2
phpcrawl
picscout
picsearch
picturefinder
pimonster
pi-monster
piplbot
pixray
pleasecrawl
plista
plukkie
plumanalytics
pockey
pockey-gethtml
poe-component-client-http
probethenet
propowerbot
propowerbot/2.14
prowebwalker
proximic
psbot
psbot
pu_in
pubcon
pub-crawler
pump
pxbroker
pycurl
python/3.5aiohttp
python-urllib
quepasacreep
queryn metasearch
queryn metasearch
queryn.metasearch
querynmetasearch
quick-crawler
qwantify
r6_commentreader
r6_feedfetcher
radian6
radiation retriever 1.1
radiationretriever1.1
rankactive
rankactivelinkbot
rankflex
rankingbot
rankingbot2
rankivabot
ranksignals
ranksonicsiteauditor
rankurbot
ravencrawler
realdownload
reaper
rebelmouse
recorder
red
redesscrapy
reget
repomonkey
repomonkeybait&tackle/v1.01
resume robot
riddler
ripper
rma
rocketcrawler
roverbot
rssingbot
s1z.ru
safednsbot
safetynet robot 0.1
salesintelligent
sapphirewebcrawler
sbider
sbsearch
scan.lol
scanalert
scanbot
scooter
scoutjet
scrapebox
scrapy
screaming
screenerbot
searchestate
searchmetricsbot
searchpreview
seekportcrawler
semrush
semrushbot-sa
senrigan/xxxxxx
sentibot
seobility
seocharger-robot
seodiver
seokicks
seokicks-robot
seolyticscrawler
seomoz
seoprofiler
seoscanners
seoscanners.net
seoscanners.net/1
seositecheckup
seostats
serpstatbot
serpstatbot/1.0
seznambot
sg-orbiter
sheer_explorer
sheerexplorer
shodan
shopwikicrawler
siphon
sistrix
sistrix crawler
sistrixcrawler
site.ru
siteauditbot
sitebeam
sitebot
sitecheck.internetseer.com
siteexplorer
siteimprove
siteliner
sitelockspider
sitesnagger
sitesucker
sitevigil
sjuupbot
slurp
slysearch
smabblerbot
smartdownload
smtbot
snake
snapbot
snooper/b97_01
snoopy
socialrankiobot
sociscraper
sogou inst spider
sogou spider
sogou web spider
sogouspider
sogouwebspider
sogouwebspider/4.0
solbot/1.0 lwp/5.07
sootle
sootle
sosospider
sottopop
sp_auditbot
spacebison
spammen
spankbot
spanner
spanner
spanner/1.0 (linux 2.0.27 i586)
spbot
spiderbot
spiderling
spiderlytics
spinn3r
sputnik
sputnikbot
sputnikbot/2.3
spyder3.microsys.com
spyfu
sqlmap
sqlworm
sqworm
sqworm/2.9.85-beta (beta_release; 20011115-775; i686-pc-linux
ssearch_bot
ssearchcrawler
stanford
stanford
stanford comp sci
stanford comp sci
stanford compclub
stanford compsciclub
stanford spiderboys
steeler
steeler/3.5
stq_bot
stripper
sucker
superbot
superbot/3.0 (win32)
superbot/3.1 (win32)
superhttp
superhttp/1.0
surdotlybot
surfbot
surveybot
suzuran
suzuran
swiftbot
sysscan
szukacz
szukacz/1.4
t0phackteam
t8abot
takeout
teleport
teleport pro
teleport\pro
teleportpro
telesoft
telesphoreo
telesphorep
teoma
the intraformant
the.intraformant
theintraformant
theknowledgeai
thenomad
thumbor
thumbshots-de-bot
thumbsniper
thunderstone
tighttwatbot
tineye
titan
toata
tocrawl/urldispatcher
toscrawler
toweya.com
toweyabot
tracemyfile
tracemyfile/1.0
trendiction
trendiction.com
trendiction.de
trendictionbot
true_robot
true_robot/1.0
turingos
turingos
turnitin
turnitin robot
turnitinbot
turnitinbot
turnitinbot/1.5
twengabot
twice
twiceler
twinglyrecon-klondike/1.0
typhoeus
ubicrawler
ucrawler
ucsd-crawler
um-ic
unisterbot
unwindfetchor/1.0
updownerbot
upflow
uptimebot
url control
url control
url_spider_pro
urlck/1.2.3
urlcontrol
urlspiderpro
urly warning
urly warning
urly.warning
urlywarning
vacuum
vagabondo
valkyrie/1.0 libwww-perl/0.40
vbproject
vbseo
vci
vci webviewer vci webviewer win32
vciwebviewervciwebviewerwin32
vebidoobot
velenpublicwebcrawler
vericitecrawler
vidiblescraper
viglink
virusdie
voideye
voil
voltron
wallpapers/3.0
wallpapershd
wasalive-bot
wbsearchbot
web image collector
web image collector
web sucker
web.image.collector
web\image\collector
web\sucker
webalta
webauto
webauto/3.40 (win98; i)
webbandit
webbandit/3.50
webcapture 2.0
webcollage
webcopier
webcopier v.2.2
webcopier v2.5
webcopier v2.6
webcopier v2.7a
webcopier v2.8
webcopier v3.0
webcopier v3.0.1
webcopier v3.2
webcopier v3.2a
webcopy/
webcrawler/3.0 robot libwww/5.0a
webdav
webemailextrac.*
webenhancer
webferret
webfetch
webfetch/2.1.0
webfetcher/0.8,
webgo is
webgo\is
webgois
webimagecollector
weblayers/0.0
webleacher
weblinker/0.0 libwww-perl/0.1
webmasterworld
webmasterworld extractor
webmasterworld extractor
webmasterworldforumbot
webmeasurement-bot
webmeup-crawler
webmoose/0.0.0000
webpix
webreaper
webs@recruit.co.jp
websauger
websauger 1.20b
websauger 1.20j
websauger 1.20k
webseoanalytics
webshag
website extractor
website quester
website quester
website.quester
website\extractor
website\quester
websiteextractor
websitequester
webster
webster pro
webster pro
webster.pro
websterpro
webstripper
webstripper/2.03
webstripper/2.10
webstripper/2.12
webstripper/2.13
webstripper/2.15
webstripper/2.16
webstripper/2.19
websucker
webvac
webvac
webvac/1.0
webwalk
webwalker
webwalker/1.10
webwatch
webwhacker
webzip
webzip
wesee
wevikabot
wget
wget/1.4.0
wget/1.5.2
wget/1.5.3
wget/1.6
wget/1.7
wget/1.8
wget/1.8.1
wget/1.8.1+cvs
wget/1.8.2
wget/1.9-beta
whack
whacker
whatweb
who.isbot
whowhere robot
widow
wikido
winhttrack
wired-digital-newsbot/1.5
wiseguys robot
wiseguysrobot
wisenutbot
wonderbot
woobot
wotbox
wprecon
wpscan
www collector
www.freeloader.com.
www: : mechanize
www-collector-e
www-mechanize
wwwoffle
wwwwanderer v3.0
x09mozilla
x22mozilla
x28-job-bot
xaldon webspider
xaldon webspider 2.5.b3
xaldon\webspider
xaldon_webspider
xaldonwebspider
xenu
xenu
xenu's
xenu's
xenu's link sleuth 1.1c
xenu'slinksleuth1.1c
xget/0.7
xovibot
xpymep1.exe
yahoo pipes 1.0
yahoo pipes 2.0
yak/1.0
yandex
yandexsomething
yasaklibot
yes
yesupbot
yeti
yeti-mobile
yisouspider
yodaobot
youdaobot
zade
zao
zauba
zauba.io
zealbot
zermelo
zeus
zeus link scout
zeus32297websterprov2.9win32
zeuslinkscout
zgrab
zitebot
zmeu
zoombot
zoominfobot
zumbot
zyborg
zyborg

Rule Path
Disallow /

Comments

  • WordPress
  • WordPress
  • Bloquage Robots SEO
  • End Robots SEO
  • Bloquage Robots indesirables

Warnings

  • 6 invalid lines.