homedelux.site
robots.txt

Robots Exclusion Standard data for homedelux.site

Resource Scan

Scan Details

Site Domain homedelux.site
Base Domain homedelux.site
Scan Status Ok
Last Scan2024-11-01T05:27:13+00:00
Next Scan 2024-12-01T05:27:13+00:00

Last Scan

Scanned2024-11-01T05:27:13+00:00
URL https://homedelux.site/robots.txt
Domain IPs 45.130.41.104
Response IP 45.130.41.104
Found Yes
Hash 86b0f37c468f183383023ccfe7c6f2c301375761175df8710bc1b5778e38d70e
SimHash 56564bd05d91

Groups

*

Rule Path
Disallow
Allow /wp-*/*.css
Allow /wp-*/*.js
Allow /wp-*/*.jpg
Allow /wp-*/*.png
Allow /wp-*/*.gif
Allow /wp-*/*.woff
Disallow /author/
Disallow /manager/
Disallow /wp-
Disallow /readme
Disallow /search
Disallow *?s=
Disallow *%26s%3D
Disallow *?utm_
Disallow *%26utm_
Disallow */reviews/
Disallow */attachment/
Disallow */embed
Disallow */page/
Disallow *fbclid%3D
Disallow *ycl%3D
Disallow *gcl%3D
Disallow *cpa%3D
Disallow *utm%3D
Disallow *clid%3D
Disallow *openstat%3D

yandex

Rule Path
Disallow
Allow /wp-*/*.css
Allow /wp-*/*.js
Allow /wp-*/*.jpg
Allow /wp-*/*.png
Allow /wp-*/*.gif
Allow /wp-*/*.woff
Disallow /author/
Disallow /manager/
Disallow /wp-
Disallow /readme
Disallow /search
Disallow *?s=
Disallow *%26s%3D
Disallow *?utm_
Disallow *%26utm_
Disallow */reviews/
Disallow */attachment/
Disallow */embed
Disallow */page/
Disallow *fbclid%3D
Disallow *ycl%3D
Disallow *gcl%3D
Disallow *cpa%3D
Disallow *utm%3D
Disallow *clid%3D
Disallow *openstat%3D

geedobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

vsagent

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

slurp

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

webartexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

vsagent

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

slurp

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

webartexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

konturbot

Rule Path
Disallow /

kocmohabt

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

fatboykimcombot

Rule Path
Disallow /

pizilla++

Rule Path
Disallow /

couponwcode bot

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mixnodecache

Rule Path
Disallow /

sitecheckerbot

Rule Path
Disallow /

woorankreview

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

tagvisit

Rule Path
Disallow /

hmeonlinehomebot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

whatcmsbot

Rule Path
Disallow /

downtimedetector

Rule Path
Disallow /

webdatastats

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

fetchbot

Rule Path
Disallow /

techleadzbot

Rule Path
Disallow /

jolokiapwn

Rule Path
Disallow /

megaindexauditbot

Rule Path
Disallow /

sukibot_heritrix

Rule Path
Disallow /

cors bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

voluumdsp-content-bot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

topvisorbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

runet-research-crawler

Rule Path
Disallow /

netpeakcheckerbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

embedly

Rule Path
Disallow /

davecrawler

Rule Path
Disallow /

prlog

Rule Path
Disallow /

rookeebot

Rule Path
Disallow /

online-webceo-bot

Rule Path
Disallow /

netpeakspiderbot

Rule Path
Disallow /

twingly recon

Rule Path
Disallow /

tiptop

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

grobbot

Rule Path
Disallow /

struts-pwn

Rule Path
Disallow /

ucrawler

Rule Path
Disallow /

elefent

Rule Path
Disallow /

tobbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

ucrawlr

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

leikibot

Rule Path
Disallow /

researchbot

Rule Path
Disallow /

findxbot

Rule Path
Disallow /

deepcrawl-ui

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

deepcrawl.com

Rule Path
Disallow /

digincore crawler bot

Rule Path
Disallow /

spiderman

Rule Path
Disallow /

gigablastopensource

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

funwebproducts

Rule Path
Disallow /

wecrawlforthepeace

Rule Path
Disallow /

testitest1

Rule Path
Disallow /

idbot

Rule Path
Disallow /

stratagems kumo

Rule Path
Disallow /

jersey

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

seopultcontentanalyzer

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

depositfiles/filemanager

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

evc-batch

Rule Path
Disallow /

embeddedwb

Rule Path
Disallow /

afb

Rule Path
Disallow /

rukicrawler

Rule Path
Disallow /

maildbbot

Rule Path
Disallow /

itroot

Rule Path
Disallow /

laserlikebot

Rule Path
Disallow /

kolahsefid.com

Rule Path
Disallow /

tsearchbot

Rule Path
Disallow /

seocharger-robot

Rule Path
Disallow /

wget

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

aiohttp

Rule Path
Disallow /

yoozbot

Rule Path
Disallow /

dataminer

Rule Path
Disallow /

woobot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

wappalyzer

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

komodiabot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

anyevent-http

Rule Path
Disallow /

gluten free crawler

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

iskanie

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

deusu

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

wmtips.com

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

glindahl-cocrawler

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

botrobin

Rule Path
Disallow /

findcloserbot

Rule Path
Disallow /

commoncrawler

Rule Path
Disallow /

metauri

Rule Path
Disallow /

webscore

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

checkmarknetwork

Rule Path
Disallow /

begunadvertising

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

hypestat

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

elanerubot

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

roboto

Rule Path
Disallow /

exabot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

mfibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tpprf

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

toweyabot

Rule Path
Disallow /

statdom.ru

Rule Path
Disallow /

kazbtbot

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Comments

  • *********************************

Warnings

  • 2 invalid lines.
  • `clean-param` is not a known field.