divainparfums.es
robots.txt

Robots Exclusion Standard data for divainparfums.es

Resource Scan

Scan Details

Site Domain divainparfums.es
Base Domain divainparfums.es
Scan Status Ok
Last Scan2024-05-23T01:15:40+00:00
Next Scan 2024-06-06T01:15:40+00:00

Last Scan

Scanned2024-05-23T01:15:40+00:00
URL https://divainparfums.es/robots.txt
Domain IPs 23.227.38.65
Response IP 23.227.38.65
Found Yes
Hash fc48c676f755a690ea0dd66e9d60cb4e9ed18b344610bc23c67d11dae0f622f4
SimHash 7e381c52b4fd

Groups

*

Rule Path
Disallow /*/pages/catalogue*
Disallow /*/pages/catalogo*
Disallow /*/pages/catalogus*
Disallow /*/pages/catalogo-perfumes-equivalencia-divain*
Disallow /*/pages/try-buy*
Disallow /*/pages/divain-try-buy*
Disallow /*/pages/path-to-free-products*
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /3715563635/checkouts
Disallow /3715563635/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /services/login_with_shop
Disallow /recommendations/
Disallow */collections/*filter*%26*filter*

adsbot-google

Rule Path
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /orders
Disallow /3715563635/checkouts
Disallow /3715563635/orders
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /cdn/wpm/*.js
Disallow /services/login_with_shop

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /3715563635/checkouts
Disallow /3715563635/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /services/login_with_shop
Disallow */collections/*filter*%26*filter*

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /3715563635/checkouts
Disallow /3715563635/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /services/login_with_shop
Disallow */collections/*filter*%26*filter*

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

abonti disallow: /
aboundex disallow: /
acunetix disallow: /
admantx disallow: /
afd-verbotsverfahren disallow: /
aibot disallow: /
aihitbot disallow: /
aipbot disallow: /
alexibot disallow: /
alligator disallow: /
allsubmitter disallow: /
alphabot disallow: /
anarchie disallow: /
apexoo disallow: /
archive.org_bot disallow: /
aspseek disallow: /
asterias disallow: /
attach disallow: /
autoemailspider disallow: /
backdoorbot/1.0 disallow: /
backlink-check disallow: /
backlinkcrawler disallow: /
backstreet disallow: /
backweb disallow: /
badass disallow: /
bandit disallow: /
barkrowler disallow: /
batchftp disallow: /
battleztar bazinga disallow: /
bbbike disallow: /
bdcbot disallow: /
bdfetch disallow: /
betabot disallow: /
bigfoot disallow: /
bitacle disallow: /
blackboard disallow: /
black hole disallow: /
blackwidow disallow: /
blexbot disallow: /
blowfish/1.0 disallow: /
boardreader disallow: /
botalot disallow: /
brandprotect disallow: /
brandwatch disallow: /
buddy disallow: /
builtbottough disallow: /
builtwith disallow: /
bullseye/1.0 disallow: /
bunnyslippers disallow: /
buzzsumo disallow: /
calculon disallow: /
catexplorador disallow: /
cazoodlebot disallow: /
ccbot disallow: /
cegbfeieh disallow: /
cheesebot disallow: /
cherrypicker disallow: /
cheteam disallow: /
chinaclaw disallow: /
chlooe disallow: /
claritybot disallow: /
cliqzbot disallow: /
cloud mapping disallow: /
coccocbot-web disallow: /
cogentbot disallow: /
cognitiveseo disallow: /
collector disallow: /
com.plumanalytics disallow: /
copier disallow: /
copyrightcheck disallow: /
copyscape disallow: /
cosmos disallow: /
craftbot disallow: /
crawler4j disallow: /
crawler.feedback disallow: /
crawl.sogou.com disallow: /
crazywebcrawlerdisallow: /
crescentdisallow: /
crescent internet toolpak http ole control v.1.0 disallow: /
crunchbot disallow: /
cshttp disallow: /
curious disallow: /
custo disallow: /
databasedrivermysqli disallow: /
datacha0s disallow: /
dblbot disallow: /
demandbase-bot disallow: /
demon disallow: /
deusu disallow: /
devil disallow: /
digincore disallow: /
digitalpebble disallow: /
diibot disallow: /
dirbuster disallow: /
discobot disallow: /
discoverybot disallow: /
dispatch disallow: /
dittospyder disallow: /
dnyzbot disallow: /
domainappender disallow: /
domaincrawler disallow: /
domainsigmacrawler disallow: /
domainstatsbot disallow: /
download wonder disallow: /
dragonfly disallow: /
drip disallow: /
dsearch disallow: /
dts agent disallow: /
easydl disallow: /
ebingbong disallow: /
ecatch disallow: /
eccp/1.0 disallow: /
ecxi disallow: /
eirgrabber disallow: /
emailcollector disallow: /
emailsiphon disallow: /
emailwolf disallow: /
erocrawler disallow: /
evc-batch disallow: /
evil disallow: /
exabot disallow: /
express webpictures disallow: /
extlinksbot disallow: /
extractorpro disallow: /
extreme picture finder disallow: /
eyenetie disallow: /
ezooms disallow: /
fdm disallow: /
femtosearchbot disallow: /
fhscan disallow: /
fimap disallow: /
flashget disallow: /
flunky disallow: /
foobot disallow: /
freeuploader disallow: /
frontpage disallow: /
fyberspider disallow: /
fyrebot disallow: /
galaxybot disallow: /
genieo disallow: /
germcrawler disallow: /
getintent disallow: /
getright disallow: /
getweb disallow: /
gigablast disallow: /
gigabot disallow: /
go-ahead-got-it disallow: /
gotit disallow: /
gozilla disallow: /
grabber disallow: /
grabnet disallow: /
grafula disallow: /
grapefx disallow: /
grapeshotcrawler disallow: /
gridbot disallow: /
gt::www disallow: /
haansoft disallow: /
haosouspider disallow: /
harvest/1.5 disallow: /
havij disallow: /
heritrix disallow: /
hloader disallow: /
hmview disallow: /
htmlparser disallow: /
http::lite disallow: /
httrack disallow: /
httplib disallow: /
humanlinks disallow: /
hybridbot disallow: /
iblog disallow: /
idbot disallow: /
id-search disallow: /
ilsebot disallow: /
image fetch disallow: /
image sucker disallow: /
indeedbot disallow: /
indy librar ydisallow: /
ia_archiver disallow: /
infonavirobot disallow: /
infotekies disallow: /
instabid disallow: /
intelliseek disallow: /
interget disallow: /
internet ninja disallow: /
internetseer disallow: /
internetvista monitor disallow: /
ips-agent disallow: /
iria disallow: /
irlbot disallow: /
iskanie disallow: /
istellabot disallow: /
jamesbot disallow: /
jbrofuzz disallow: /
jennybot disallow: /
jetcar disallow: /
jetty disallow: /
jikespider disallow: /
joc web spider disallow: /
jorgee disallow: /
justview disallow: /
jyxobot disallow: /
kenjin spider disallow: /
keyword density/0.9 disallow: /
kozmosbotdisallow: /
larbin disallow: /
leechftp disallow: /
leechget disallow: /
lexibot disallow: /
lftp disallow: /
libweb/clshttp disallow: /
libwhisker disallow: /
lightspeedsystems disallow: /
likse disallow: /
linkdexbot disallow: /
linkextractorpro disallow: /
linkscan/8.1a unix disallow: /
linksmanager disallow: /
linkwalker disallow: /
linqiarssbot disallow: /
linqiascrapebot disallow: /
lipperhey disallow: /
lipperhey spider disallow: /
litemage_walker disallow: /
lmspider disallow: /
lnspiderguy disallow: /
lwp-trivial disallow: /
lwp-trivial/1.34 disallow: /
magnet disallow: /
magpie-crawler disallow: /
mail.ru_bot disallow: /
majestic12 disallow: /
markmonitor disallow: /
markwatc hdisallow: /
masscan disallow: /
mass downloader disallow: /
mata hari disallow: /
mauibot disallow: / user-agent: meanpathbot disallow: /
mediatoolkitbot disallow: /
mediawords disallow: /
megaindex.ru disallow: /
metauri disallow: /
mfc_tear_sample disallow: /

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://divainparfums.es/sitemap.xml

Comments

  • we use Shopify as our ecommerce platform
  • Begin block Bad-Robots from robots.txt User-agent: 360Spider Disallow: /

Warnings

  • 4 invalid lines.