divainparfums.fr
robots.txt
Robots Exclusion Standard data for divainparfums.fr
Resource Scan
Scan Details
Site Domain | divainparfums.fr |
Base Domain | divainparfums.fr |
Scan Status | Ok |
Last Scan | 2024-09-21T23:13:42+00:00 |
Next Scan | 2024-10-05T23:13:42+00:00 |
Last Scan
Scanned | 2024-09-21T23:13:42+00:00 |
URL | https://divainparfums.fr/robots.txt |
Domain IPs | 23.227.38.65 |
Response IP | 23.227.38.65 |
Found | Yes |
Hash | 8e02318486e647922b04ab766ae8dbaba25b6e7e016c8e180d9498d7558236da |
SimHash | 7e381cdaa4bd |
Groups
*
Rule | Path |
---|---|
Disallow | /*/pages/catalogue* |
Disallow | /*/pages/catalogo* |
Disallow | /*/pages/catalogus* |
Disallow | /*/pages/catalogo-perfumes-equivalencia-divain* |
Disallow | /*/pages/try-buy* |
Disallow | /*/pages/divain-try-buy* |
Disallow | /*/pages/path-to-free-products* |
Disallow | /a/downloads/-/* |
Disallow | /admin |
Disallow | /cart |
Disallow | /orders |
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | /75328291131/checkouts |
Disallow | /75328291131/orders |
Disallow | /carts |
Disallow | /account |
Disallow | /collections/*sort_by* |
Disallow | /*/collections/*sort_by* |
Disallow | /collections/*%2B* |
Disallow | /collections/*%2B* |
Disallow | /collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | */collections/*filter*%26*filter* |
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*?*oseid=* |
Disallow | /*preview_theme_id* |
Disallow | /*preview_script_id* |
Disallow | /policies/ |
Disallow | /*/policies/ |
Disallow | /*/*?*ls=*&ls=* |
Disallow | /*/*?*ls%3D*%3Fls%3D* |
Disallow | /*/*?*ls%3D*%3Fls%3D* |
Disallow | /search |
Disallow | /apple-app-site-association |
Disallow | /.well-known/shopify/monorail |
Disallow | /cdn/wpm/*.js |
Disallow | /recommendations/products |
Disallow | /*/recommendations/products |
adsbot-google
Rule | Path |
---|---|
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | /carts |
Disallow | /orders |
Disallow | /75328291131/checkouts |
Disallow | /75328291131/orders |
Disallow | /*?*oseid=* |
Disallow | /*preview_theme_id* |
Disallow | /*preview_script_id* |
Disallow | /cdn/wpm/*.js |
ahrefsbot
Rule | Path |
---|---|
Disallow | /a/downloads/-/* |
Disallow | /admin |
Disallow | /cart |
Disallow | /orders |
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | /75328291131/checkouts |
Disallow | /75328291131/orders |
Disallow | /carts |
Disallow | /account |
Disallow | /collections/*sort_by* |
Disallow | /*/collections/*sort_by* |
Disallow | /collections/*%2B* |
Disallow | /collections/*%2B* |
Disallow | /collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | */collections/*filter*%26*filter* |
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*?*oseid=* |
Disallow | /*preview_theme_id* |
Disallow | /*preview_script_id* |
Disallow | /policies/ |
Disallow | /*/policies/ |
Disallow | /*/*?*ls=*&ls=* |
Disallow | /*/*?*ls%3D*%3Fls%3D* |
Disallow | /*/*?*ls%3D*%3Fls%3D* |
Disallow | /search |
Disallow | /apple-app-site-association |
Disallow | /.well-known/shopify/monorail |
Disallow | /cdn/wpm/*.js |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
ahrefssiteaudit
Rule | Path |
---|---|
Disallow | /a/downloads/-/* |
Disallow | /admin |
Disallow | /cart |
Disallow | /orders |
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | /75328291131/checkouts |
Disallow | /75328291131/orders |
Disallow | /carts |
Disallow | /account |
Disallow | /collections/*sort_by* |
Disallow | /*/collections/*sort_by* |
Disallow | /collections/*%2B* |
Disallow | /collections/*%2B* |
Disallow | /collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | /*/collections/*%2B* |
Disallow | */collections/*filter*%26*filter* |
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*?*oseid=* |
Disallow | /*preview_theme_id* |
Disallow | /*preview_script_id* |
Disallow | /policies/ |
Disallow | /*/policies/ |
Disallow | /*/*?*ls=*&ls=* |
Disallow | /*/*?*ls%3D*%3Fls%3D* |
Disallow | /*/*?*ls%3D*%3Fls%3D* |
Disallow | /search |
Disallow | /apple-app-site-association |
Disallow | /.well-known/shopify/monorail |
Disallow | /cdn/wpm/*.js |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
abonti disallow: /
aboundex disallow: /
acunetix disallow: /
admantx disallow: /
afd-verbotsverfahren disallow: /
aibot disallow: /
aihitbot disallow: /
aipbot disallow: /
alexibot disallow: /
alligator disallow: /
allsubmitter disallow: /
alphabot disallow: /
anarchie disallow: /
apexoo disallow: /
archive.org_bot disallow: /
aspseek disallow: /
asterias disallow: /
attach disallow: /
autoemailspider disallow: /
backdoorbot/1.0 disallow: /
backlink-check disallow: /
backlinkcrawler disallow: /
backstreet disallow: /
backweb disallow: /
badass disallow: /
bandit disallow: /
barkrowler disallow: /
batchftp disallow: /
battleztar bazinga disallow: /
bbbike disallow: /
bdcbot disallow: /
bdfetch disallow: /
betabot disallow: /
bigfoot disallow: /
bitacle disallow: /
blackboard disallow: /
black hole disallow: /
blackwidow disallow: /
blexbot disallow: /
blowfish/1.0 disallow: /
boardreader disallow: /
botalot disallow: /
brandprotect disallow: /
brandwatch disallow: /
buddy disallow: /
builtbottough disallow: /
builtwith disallow: /
bullseye/1.0 disallow: /
bunnyslippers disallow: /
buzzsumo disallow: /
calculon disallow: /
catexplorador disallow: /
cazoodlebot disallow: /
ccbot disallow: /
cegbfeieh disallow: /
cheesebot disallow: /
cherrypicker disallow: /
cheteam disallow: /
chinaclaw disallow: /
chlooe disallow: /
claritybot disallow: /
cliqzbot disallow: /
cloud mapping disallow: /
coccocbot-web disallow: /
cogentbot disallow: /
cognitiveseo disallow: /
collector disallow: /
com.plumanalytics disallow: /
copier disallow: /
copyrightcheck disallow: /
copyscape disallow: /
cosmos disallow: /
craftbot disallow: /
crawler4j disallow: /
crawler.feedback disallow: /
crawl.sogou.com disallow: /
crazywebcrawlerdisallow: /
crescentdisallow: /
crescent internet toolpak http ole control v.1.0 disallow: /
crunchbot disallow: /
cshttp disallow: /
curious disallow: /
custo disallow: /
databasedrivermysqli disallow: /
datacha0s disallow: /
dblbot disallow: /
demandbase-bot disallow: /
demon disallow: /
deusu disallow: /
devil disallow: /
digincore disallow: /
digitalpebble disallow: /
diibot disallow: /
dirbuster disallow: /
discobot disallow: /
discoverybot disallow: /
dispatch disallow: /
dittospyder disallow: /
dnyzbot disallow: /
domainappender disallow: /
domaincrawler disallow: /
domainsigmacrawler disallow: /
domainstatsbot disallow: /
download wonder disallow: /
dragonfly disallow: /
drip disallow: /
dsearch disallow: /
dts agent disallow: /
easydl disallow: /
ebingbong disallow: /
ecatch disallow: /
eccp/1.0 disallow: /
ecxi disallow: /
eirgrabber disallow: /
emailcollector disallow: /
emailsiphon disallow: /
emailwolf disallow: /
erocrawler disallow: /
evc-batch disallow: /
evil disallow: /
exabot disallow: /
express webpictures disallow: /
extlinksbot disallow: /
extractorpro disallow: /
extreme picture finder disallow: /
eyenetie disallow: /
ezooms disallow: /
fdm disallow: /
femtosearchbot disallow: /
fhscan disallow: /
fimap disallow: /
flashget disallow: /
flunky disallow: /
foobot disallow: /
freeuploader disallow: /
frontpage disallow: /
fyberspider disallow: /
fyrebot disallow: /
galaxybot disallow: /
genieo disallow: /
germcrawler disallow: /
getintent disallow: /
getright disallow: /
getweb disallow: /
gigablast disallow: /
gigabot disallow: /
go-ahead-got-it disallow: /
gotit disallow: /
gozilla disallow: /
grabber disallow: /
grabnet disallow: /
grafula disallow: /
grapefx disallow: /
grapeshotcrawler disallow: /
gridbot disallow: /
gt::www disallow: /
haansoft disallow: /
haosouspider disallow: /
harvest/1.5 disallow: /
havij disallow: /
heritrix disallow: /
hloader disallow: /
hmview disallow: /
htmlparser disallow: /
http::lite disallow: /
httrack disallow: /
httplib disallow: /
humanlinks disallow: /
hybridbot disallow: /
iblog disallow: /
idbot disallow: /
id-search disallow: /
ilsebot disallow: /
image fetch disallow: /
image sucker disallow: /
indeedbot disallow: /
indy librar ydisallow: /
ia_archiver disallow: /
infonavirobot disallow: /
infotekies disallow: /
instabid disallow: /
intelliseek disallow: /
interget disallow: /
internet ninja disallow: /
internetseer disallow: /
internetvista monitor disallow: /
ips-agent disallow: /
iria disallow: /
irlbot disallow: /
iskanie disallow: /
istellabot disallow: /
jamesbot disallow: /
jbrofuzz disallow: /
jennybot disallow: /
jetcar disallow: /
jetty disallow: /
jikespider disallow: /
joc web spider disallow: /
jorgee disallow: /
justview disallow: /
jyxobot disallow: /
kenjin spider disallow: /
keyword density/0.9 disallow: /
kozmosbotdisallow: /
larbin disallow: /
leechftp disallow: /
leechget disallow: /
lexibot disallow: /
lftp disallow: /
libweb/clshttp disallow: /
libwhisker disallow: /
lightspeedsystems disallow: /
likse disallow: /
linkdexbot disallow: /
linkextractorpro disallow: /
linkscan/8.1a unix disallow: /
linksmanager disallow: /
linkwalker disallow: /
linqiarssbot disallow: /
linqiascrapebot disallow: /
lipperhey disallow: /
lipperhey spider disallow: /
litemage_walker disallow: /
lmspider disallow: /
lnspiderguy disallow: /
lwp-trivial disallow: /
lwp-trivial/1.34 disallow: /
magnet disallow: /
magpie-crawler disallow: /
mail.ru_bot disallow: /
majestic12 disallow: /
markmonitor disallow: /
markwatc hdisallow: /
masscan disallow: /
mass downloader disallow: /
mata hari disallow: /
mauibot disallow: / user-agent: meanpathbot disallow: /
mediatoolkitbot disallow: /
mediawords disallow: /
megaindex.ru disallow: /
metauri disallow: /
mfc_tear_sample disallow: /
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
sitemap | https://divainparfums.fr/sitemap.xml |
Warnings
- 4 invalid lines.
Comments