deco-americaine.com
robots.txt
Robots Exclusion Standard data for deco-americaine.com
Resource Scan
Scan Details
| Site Domain | deco-americaine.com |
| Base Domain | deco-americaine.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T07:51:48+00:00 |
| Next Scan | 2024-12-16T07:51:48+00:00 |
Last Scan
| Scanned | 2024-11-16T07:51:48+00:00 |
| URL | https://deco-americaine.com/robots.txt |
| Domain IPs | 109.234.166.160 |
| Response IP | 109.234.166.160 |
| Found | Yes |
| Hash | 3f3b820c0145a145cfb8bcdf9dac4ec3bf8c3357082d13cdaeef42804c2e96f6 |
| SimHash | 625953c367a1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /*.php$ |
| Disallow | /*.inc$ |
| Disallow | /*.gz$ |
| Disallow | /*.cgi$ |
| Disallow | */trackback |
| Disallow | /*/feed |
| Disallow | /*/comments |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /wp-login.php |
| Disallow | /wp-admin |
*
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cli/ |
| Disallow | /installation/ |
| Disallow | /logs/ |
googlebot
googlebot-mobile
googlebot-image
bingbot
msnbot
msnbot-media
slurp
yahoo! slurp
yandex
yandexbot
duckduckbot
duckduckbot/1.1
baiduspider
qwantify
qwantify/2.0
teoma
| Rule | Path |
|---|---|
| Disallow | /wp-login.php |
| Disallow | /wp-admin |
| Disallow | /exemples/ |
| Disallow | /php/ |
| Allow | /images/ |
| Allow | /js/ |
| Allow | /css/ |
| Allow | /wp-content/ |
| Allow | /wp-content/uploads/ |
| Allow | /wp-content/plugins/ |
| Allow | /wp-content/themes/ |
| Allow | /wp-content/plugins/elementor-pro/*.js$ |
| Allow | /wp-content/plugins/elementor-pro/*.css$ |
| Allow | /plugins/bdthemes-element-pack |
| Allow | /wp-content/plugins/dimage-360 |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | .js |
| Allow | .css |
| Allow | *.js |
| Allow | *.css |
asterias
backlinkcrawler
backdoorbot/1.0
bdbrandprotect
builtbottough
bullseye/1.0
blowfish/1.0
botalot
black hole
bunnyslippers
bpimagewalker
cheesebot
cherrypicker
cherrypickerse/1.0
cherrypickerelite/1.0
cliqzbot
copyrightcheck
cegbfeieh
crescent
crescent internet toolpak http ole control v.1.0
cosmos
diibot
download ninja
dittospyder
doc
url_spider_pro
emailcollector
emailsiphon
emailwolf
extractorpro
erocrawler
fetch
ecatch
psbot
ezooms
findlinks
foobot
gigabot
grub-client
harvest/1.5
httrack
httrack 3.0
httplib
hloader
humanlinks
ia_archiver
infonavirobot
jetbot
jennybot
keyword density/0.9
k2spider
kenjin spider
lnspiderguy
linkextractorpro
lwp-trivial/1.34
lwp-trivial
libweb/clshttp
linkwalker
linkscan/8.1a unix
lexibot
linkwalker
larbin
libwww
linko
mata hari
moget
moget/2.1
msiecrawler
miixpc/4.2
miixpc
mozilla/4.0 (compatible; bullseye; windows 95)
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
mister pix
microsoft.url.control
nicerspro
netmechanic
npbot
netants
net vampire
nutch
openfind data gathere
openfind
offline explorer
prowebwalker
propowerbot/2.14
python-urllib
quepasacreep
queryn metasearch
repomonkey bait & tackle/v1.01
repomonkey
rogerbot
roverbot
rma
sitesnagger
sitecheck.internetseer.com
sogou web spider
sosospider
suzuran
szukacz/1.4
spbot
updownerbot
semalt.com
scrapy
siteexplorer findxbot garlikcrawler
spanner
spankbot
teleport
teleportpro
turingos
turnitinbot
telesoft
the intraformant
true_robot/1.0
true_robot
tocrawl/urldispatcher
thenomad
titan
tighttwatbot
ubicrawler
urly warning
vci webviewer vci webviewer win32
vci
web image collector
wget/1.6
wget
webmasterworldforumbot
webreaper
website quester
webster pro
webenhancer
webauto
webzip
webstripper
webzip/4.0
webbandit
webbandit/3.50
websauger
webcopier
webzip
wget
wget/1.5.3
www-collector-e
yisouspider
yoozbot
zeus
zeus 32297 webster pro v2.9 win32
zao
zealbot
zite
zookabot
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 2 invalid lines.
Comments