Log In Sign Up

urban-drinks.fr
robots.txt

Robots Exclusion Standard data for urban-drinks.fr

Resource Scan

Scan Details

Site Domain urban-drinks.fr
Base Domain urban-drinks.fr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-04T13:40:20+00:00
Next Scan 2025-01-02T13:40:20+00:00

Last Successful Scan

Scanned2022-12-07T02:36:29+00:00
URL https://urban-drinks.fr/robots.txt
Redirect https://www.urban-drinks.fr/robots.txt
Redirect Domain www.urban-drinks.fr
Redirect Base urban-drinks.fr
Domain IPs 192.124.249.168
Redirect IPs 192.124.249.168
Response IP 192.124.249.168
Found Yes
Hash 533112d3913c4904583d15cc615837199a8b2787e44f62f881db437ad9ff03e3
SimHash 659b61c24599

Groups

*

Rule Path
Disallow /stars/*/page/
Disallow /de/stars/*/page/
Disallow /en/stars/*/page/
Disallow /fr/stars/*/page/
Disallow /*?SID=
Disallow /*.sh$
Disallow /*.md$
Disallow /*.json$
Disallow /*.bat$
Disallow /*.php$
Disallow /index.php/
Disallow /de/index.php/
Disallow /en/index.php/
Disallow /fr/index.php/
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /404/
Disallow /admin/
Disallow /app/
Disallow /catalogsearch/
Disallow /de/catalogsearch/
Disallow /en/catalogsearch/
Disallow /fr/catalogsearch/
Disallow /downloader/
Disallow /lib/
Disallow /newsletter/
Disallow /de/newsletter/
Disallow /en/newsletter/
Disallow /fr/newsletter/
Disallow /pkginfo/
Disallow /report/
Disallow /de/report/
Disallow /en/report/
Disallow /fr/report/
Disallow /review/
Disallow /de/review/
Disallow /en/review/
Disallow /fr/review/
Disallow /var/
Disallow /wishlist/
Disallow /de/wishlist/
Disallow /en/wishlist/
Disallow /fr/wishlist/
Disallow /cgi-bin/
Disallow /dev/
Disallow /errors/
Disallow /includes/
Disallow /package/
Disallow /sap/
Disallow /selection-prestige/
Disallow /scripts/
Disallow /shell/
Disallow /stats/
Disallow /de/stats/
Disallow /en/stats/
Disallow /fr/stats/
Disallow /data/
Disallow /_data/
Disallow /amazonpayments/
Disallow /mailchimp/
Disallow /m2epro/
Disallow /debit/
Disallow /checkoutpersistence/
Disallow /developertoolbar/
Disallow /billsafe/
Disallow /paymentfee/
Disallow /payone_core/
Disallow /payonelicensemanager/
Disallow /moneybookers/
Disallow /amfeed/
Disallow /smtppro/
Disallow /outofstocksubscription/
Disallow /attributemanager/
Disallow /secretpricecheckout/
Disallow /giftvoucher/
Disallow /mana/
Disallow /mana_infinitescrolling/
Disallow /mana_seo/
Disallow /mana_content/
Disallow /manapro_filterajax/
Disallow /manapro_filtershowmore/
Disallow /manapro_filtertree/
Disallow /mstcore/
Disallow /searchautocomplete/
Disallow /searchindex/
Disallow /searchlandingpage/
Disallow /searchsphinx/
Disallow /seoautolink/
Disallow /contacts/
Disallow /home/
Disallow /spproductalert/
Disallow /no_route/
Disallow /api/
Disallow /api2/
Disallow /authorizenet/
Disallow /captcha/
Disallow /centinel/
Disallow /core/
Disallow /directory/
Disallow /downloadable/
Disallow /giftmessage/
Disallow /install/
Disallow /oauth/
Disallow /paygate/
Disallow /paypal/
Disallow /payflow/
Disallow /persistent/
Disallow /poll/
Disallow /productalert/
Disallow /rss/
Disallow /sales/
Disallow /sendfriend/
Disallow /shipping/
Disallow /tag/
Disallow /xmlconnect/
Disallow /*?___store=
Disallow /*%26___store%3D
Disallow /*?___from_store=
Disallow /*%26___from_store%3D
Disallow /*?__c=
Disallow /*%26__c%3D
Disallow /*%26av%3D
Disallow /*?bsize=
Disallow /*%26bsize%3D
Disallow /*?ageing_time=
Disallow /*%26ageing_time%3D
Disallow /*?ageing_time_unit=
Disallow /*%26ageing_time_unit%3D
Disallow /*?age_grade2=
Disallow /*%26age_grade2%3D
Disallow /*?beer_type=
Disallow /*%26beer_type%3D
Disallow /*?champagne_type=
Disallow /*%26champagne_type%3D
Disallow /*?color=
Disallow /*%26color%3D
Disallow /*%26country_of_manufacture%3D
Disallow /*?dossage=
Disallow /*%26dossage%3D
Disallow /*?dress_type=
Disallow /*%26dress_type%3D
Disallow /*?gin_type=
Disallow /*%26gin_type%3D
Disallow /*?liqueur_type=
Disallow /*%26liqueur_type%3D
Disallow /*?manufacturer=
Disallow /*%26manufacturer%3D
Disallow /*?mescal_type=
Disallow /*%26mescal_type%3D
Disallow /*?price=
Disallow /*%26price%3D
Disallow /*?rockstar_name=
Disallow /*%26rockstar_name%3D
Disallow /*?rock_star_filterable_name=
Disallow /*%26rock_star_filterable_name%3D
Disallow /*?rum_type=
Disallow /*%26rum_type%3D
Disallow /*?set_type=
Disallow /*%26set_type%3D
Disallow /*?size=
Disallow /*%26size%3D
Disallow /*?softdrink_type=
Disallow /*%26softdrink_type%3D
Disallow /*?star_filterable_name=
Disallow /*%26star_filterable_name%3D
Disallow /*?taste=
Disallow /*%26taste%3D
Disallow /*?vintages=
Disallow /*%26vintages%3D
Disallow /*?vodka_based=
Disallow /*%26vodka_based%3D
Disallow /*?vodka_type=
Disallow /*%26vodka_type%3D
Disallow /*?whisky_type=
Disallow /*%26whisky_type%3D
Disallow /*?accessory_type=
Disallow /*%26accessory_type%3D
Disallow /*%26language%3D
Disallow /*?cat=
Disallow /*%26cat%3D
Disallow /*?filter_id=
Disallow /*%26filter_id%3D
Disallow /*?review-form=
Disallow /*%26review-form%3D
Disallow /*?zanpid=
Disallow /*%26zanpid%3D
Disallow /*?gclid=
Disallow /*%26gclid%3D
Disallow /checkout/
Disallow /de/checkout/
Disallow /en/checkout/
Disallow /fr/checkout/
Disallow /customer/
Disallow /de/customer/
Disallow /en/customer/
Disallow /fr/customer/
Disallow /onestepcheckout/
Disallow /de/onestepcheckout/
Disallow /en/onestepcheckout/
Disallow /fr/onestepcheckout/
Disallow /*/sort-by/*
Disallow /*/show/*
Disallow /uxajax/
Disallow /de/uxajax/
Disallow /en/uxajax/
Disallow /fr/uxajax/
Disallow /helpdesk/
Disallow /de/helpdesk/
Disallow /en/helpdesk/
Disallow /fr/helpdesk/

Other Records

Field Value
crawl-delay 10

adressendeutschland

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alligator

Rule Path
Disallow /

arste

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

betabot

Rule Path
Disallow /

botonparade

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

china

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

cloakbrowser

Rule Path
Disallow /

dattatec

Rule Path
Disallow /

dailyperfect

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

dblbot

Rule Path
Disallow /

dts

Rule Path
Disallow /

domaindatei.de

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extrabot

Rule Path
Disallow /

exdomain

Rule Path
Disallow /

fantombrowser

Rule Path
Disallow /

fantomcrew

Rule Path
Disallow /

filehound

Rule Path
Disallow /

finder

Rule Path
Disallow /

franklin

Rule Path
Disallow /

geohasher

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

gonzo1

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

iceweasel

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

industry

Rule Path
Disallow /

iufw

Rule Path
Disallow /

iupui

Rule Path
Disallow /

jobo

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lincoln

Rule Path
Disallow /

linguee

Rule Path
Disallow /

linksweeper

Rule Path
Disallow /

majestic12

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

microcomputers

Rule Path
Disallow /

missauga

Rule Path
Disallow /

missigua

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

nationaldirectory

Rule Path
Disallow /

naver

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

nutch

Rule Path
Disallow /

obot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

psbot

Rule Path
Disallow /

qualidatorsiteanalyzer

Rule Path
Disallow /

qualidatorwebsiteanalyzer

Rule Path
Disallow /

qualidatorbot

Rule Path
Disallow /

rainbow

Rule Path
Disallow /

search17

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

shareware

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

stealthbrowser

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

sweeper

Rule Path
Disallow /

taptubot

Rule Path
Disallow /

terranautic

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twenga

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

wep

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.urban-drinks.de/sitemaps/udde/sitemap.xml
sitemap https://www.urban-drinks.de/sitemaps/uden/sitemap.xml
sitemap https://www.urban-drinks.de/blog/sitemap_index.xml
sitemap https://www.urban-drinks.at/sitemaps/udat/sitemap.xml
sitemap https://www.urban-drinks.fr/sitemaps/udfr/sitemap.xml
sitemap https://www.urban-drinks.fr/blogfr/sitemap_index.xml
sitemap https://www.urban-drinks.co.uk/sitemaps/uduk/sitemap.xml
sitemap https://www.urban-drinks.co.uk/bloguk/sitemap_index.xml
sitemap https://www.urban-drinks.com/sitemaps/udcom/sitemap.xml
sitemap https://www.rock-drinks.de/sitemaps/rdde/sitemap.xml
sitemap https://www.selection-prestige.de/sitemaps/sp.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top