prophila.com
robots.txt

Robots Exclusion Standard data for prophila.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	prophila.com
Base Domain	prophila.com
Scan Status	Ok
Last Scan	2024-10-28T16:23:57+00:00
Next Scan	2024-11-27T16:23:57+00:00

Last Scan

Scanned	2024-10-28T16:23:57+00:00
URL	https://www.prophila.com/robots.txt
Domain IPs	37.61.205.158
Response IP	37.61.205.158
Found	Yes
Hash	7cacc41097bf63903353ebd0101a42ecd9d65faf95f2c26d6720ccbeecea98d2
SimHash	3066639381f7

Groups

googlebot

Rule	Path
Allow	/
Disallow	/empfehlen_mail*
Disallow	/vbest_cart*
Disallow	/cart*
Disallow	/checkout*
Disallow	/prod_list*
Disallow	/artikel/suche*
Disallow	/util-functions.js
Disallow	/format*

Rule

Path

Allow

Disallow

/empfehlen_mail*

Disallow

/vbest_cart*

Disallow

/cart*

Disallow

/checkout*

Disallow

/prod_list*

Disallow

/artikel/suche*

Disallow

/util-functions.js

Disallow

/format*

googlebot-mobile

Rule	Path
Allow	/
Disallow	/empfehlen_mail*
Disallow	/vbest_cart*
Disallow	/cart*
Disallow	/checkout*
Disallow	/prod_list*
Disallow	/artikel/suche*
Disallow	/util-functions.js
Disallow	/format*

Rule

Path

Allow

Disallow

/empfehlen_mail*

Disallow

/vbest_cart*

Disallow

/cart*

Disallow

/checkout*

Disallow

/prod_list*

Disallow

/artikel/suche*

Disallow

/util-functions.js

Disallow

/format*

adsbot-google

Rule	Path
Allow	/
Disallow	/empfehlen_mail*
Disallow	/vbest_cart*
Disallow	/cart*
Disallow	/checkout*
Disallow	/prod_list*
Disallow	/artikel/suche*
Disallow	/util-functions.js
Disallow	/format*

Rule

Path

Allow

Disallow

/empfehlen_mail*

Disallow

/vbest_cart*

Disallow

/cart*

Disallow

/checkout*

Disallow

/prod_list*

Disallow

/artikel/suche*

Disallow

/util-functions.js

Disallow

/format*

googlebot-image

Rule	Path
Allow	/
Disallow	/empfehlen_mail*
Disallow	/vbest_cart*
Disallow	/cart*
Disallow	/checkout*
Disallow	/prod_list*
Disallow	/artikel/suche*
Disallow	/util-functions.js
Disallow	/format*

Rule

Path

Allow

Disallow

/empfehlen_mail*

Disallow

/vbest_cart*

Disallow

/cart*

Disallow

/checkout*

Disallow

/prod_list*

Disallow

/artikel/suche*

Disallow

/util-functions.js

Disallow

/format*

*

Rule	Path
Disallow	/empfehlen_mail*
Disallow	/vbest_cart*
Disallow	/cart*
Disallow	/checkout*
Disallow	/prod_list*
Disallow	/artikel/suche*
Disallow	/util-functions.js
Disallow	/format*

Rule

Path

Disallow

/empfehlen_mail*

Disallow

/vbest_cart*

Disallow

/cart*

Disallow

/checkout*

Disallow

/prod_list*

Disallow

/artikel/suche*

Disallow

/util-functions.js

Disallow

/format*

awariobot

Rule	Path
Disallow	/

Rule

Path

Disallow

imagesiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookexternalhit

Rule	Path
Disallow	/

Rule

Path

Disallow

alibaba

Rule	Path
Disallow	/

Rule

Path

Disallow

etaospider

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seekportbot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

orangebot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

xovibot

Rule	Path
Disallow	/

Rule

Path

Disallow

alphabot

Rule	Path
Disallow	/

Rule

Path

Disallow

nekstbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mediatookkitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

surdotlybot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

memorybot

Rule	Path
Disallow	/

Rule

Path

Disallow

twengabot

Rule	Path
Disallow	/

Rule

Path

Disallow

webhistorybot

Rule	Path
Disallow	/

Rule

Path

Disallow

linkdexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

psbot

Rule	Path
Disallow	/

Rule

Path

Disallow

istellabot

Rule	Path
Disallow	/

Rule

Path

Disallow

uptimebot

Rule	Path
Disallow	/

Rule

Path

Disallow

jobboersebot

Rule	Path
Disallow	/

Rule

Path

Disallow

youdaobot

Rule	Path
Disallow	/

Rule

Path

Disallow

naverbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

xovibot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks

Rule	Path
Disallow	/

Rule

Path

Disallow

qwantify

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

bspider

Rule	Path
Disallow	/

Rule

Path

Disallow

jikespider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou

Rule

Path

Disallow

youdao

Rule

Path

Disallow

naver

Rule

Path

Disallow

yeti

Rule

Path

Disallow

moget

Rule

Path

Disallow

ichiro

Rule

Path

Disallow

paessler

Rule

Path

Disallow

kraken

Rule

Path

Disallow

ezooms

Rule

Path

Disallow

spbot

Rule

Path

Disallow

ia_archiver

Rule

Path

Disallow

yeti

Rule

Path

Disallow

istellabot

Rule

Path

Disallow

webcr/1.0

Rule

Path

Disallow

spamfilter

Rule

Path

Disallow

synapse

Rule

Path

Disallow

admantx

Rule

Path

Disallow

slurp

Rule

Path

Disallow

voila

Rule

Path

Disallow

mediatookkitbot

Rule

Path

Disallow

archive.org_bot

Rule

Path

Disallow

mail.ru

Rule

Path

Disallow

bnf.fr_bot

Rule

Path

Disallow

yacybot

Rule

Path

Disallow

stackrambler

Rule

Path

Disallow

phantom

Rule

Path

Disallow

fish

Rule

Path

Disallow

seznam

Rule

Path

Disallow

crw

Rule

Path

Disallow

qcrawl

Rule

Path

Disallow

mtibytes

Rule

Path

Disallow

linkfluence

Rule

Path

Disallow

applebot

Rule

Path

Disallow

shuame

Rule

Path

Disallow

bsalsa

Rule

Path

Disallow

metasr

Rule

Path

Disallow

bidubrowser

Rule

Path

Disallow

lbbrowser

Rule

Path

Disallow

qqbrowser

Rule

Path

Disallow

theworld

Rule

Path

Disallow

juzibrowser

Rule

Path

Disallow

shuame

Rule

Path

Disallow

qqdownload

Rule

Path

Disallow

biduplayer

Rule

Path

Disallow

maxthon

Rule

Path

Disallow

tencenttraveler

Rule

Path

Disallow

avant

Rule

Path

Disallow

metasr

Rule

Path

Disallow

adscanner

Rule

Path

Disallow

liebaofast

Rule

Path

Disallow

mb2345browser

Rule

Path

Disallow

mqqbrowser

Rule

Path

Disallow

micromessenger

Rule

Path

Disallow

sqlmap

Rule

Path

Disallow

openlinkprofiler

Rule

Path

Disallow

ltx71

Rule

Path

Disallow

linguee

Rule

Path

Disallow

hubspot

Rule

Path

Disallow

quant

Rule

Path

Disallow

seoscanners

Rule

Path

Disallow

vagabondo

Rule

Path

Disallow

magebee

Rule

Path

Disallow

reanimator

Rule

Path

Disallow

zoominfobot

Rule

Path

Disallow

dataforseo

Rule

Path

Disallow

baiduspider

Rule

Path

Disallow

baiduspider-video

Rule

Path

Disallow

baiduspider-image

Rule

Path

Disallow

yandex

Rule

Path

Disallow

admantx

Rule

Path

Disallow

aibot

Rule

Path

Disallow

alittle client

Rule

Path

Disallow

aspseek

Rule

Path

Disallow

abonti

Rule

Path

Disallow

aboundex

Rule

Path

Disallow

aboundexbot

Rule

Path

Disallow

acunetix

Rule

Path

Disallow

adstxtcrawlertp

Rule

Path

Disallow

afd-verbotsverfahren

Rule

Path

Disallow

ahrefsbot

Rule

Path

Disallow

aihitbot

Rule

Path

Disallow

aipbot

Rule

Path

Disallow

alexibot

Rule

Path

Disallow

allsubmitter

Rule

Path

Disallow

alligator

Rule

Path

Disallow

alphabot

Rule

Path

Disallow

anarchie

Rule

Path

Disallow

anarchy

Rule

Path

Disallow

anarchy99

Rule

Path

Disallow

ankit

Rule

Path

Disallow

anthill

Rule

Path

Disallow

apexoo

Rule

Path

Disallow

aspiegel

Rule

Path

Disallow

asterias

Rule

Path

Disallow

atomseobot

Rule

Path

Disallow

attach

Rule

Path

Disallow

awariorssbot

Rule

Path

Disallow

awariosmartbot

Rule

Path

Disallow

bbbike

Rule

Path

Disallow

bdcbot

Rule

Path

Disallow

bdfetch

Rule

Path

Disallow

blexbot

Rule

Path

Disallow

backdoorbot

Rule

Path

Disallow

backstreet

Rule

Path

Disallow

backweb

Rule

Path

Disallow

backlink-ceck

Rule

Path

Disallow

backlinkcrawler

Rule

Path

Disallow

badass

Rule

Path

Disallow

bandit

Rule

Path

Disallow

barkrowler

Rule

Path

Disallow

batchftp

Rule

Path

Disallow

battleztar bazinga

Rule

Path

Disallow

betabot

Rule

Path

Disallow

bigfoot

Rule

Path

Disallow

bitacle

Rule

Path

Disallow

black hole

Rule

Path

Disallow

blackwidow

Rule

Path

Disallow

blackboard

Rule

Path

Disallow

blow

Rule

Path

Disallow

blowfish

Rule

Path

Disallow

boardreader

Rule

Path

Disallow

bolt

Rule

Path

Disallow

botalot

Rule

Path

Disallow

brandprotect

Rule

Path

Disallow

brandwatch

Rule

Path

Disallow

buck

Rule

Path

Disallow

buddy

Rule

Path

Disallow

builtbottough

Rule

Path

Disallow

builtwith

Rule

Path

Disallow

bullseye

Rule

Path

Disallow

bunnyslippers

Rule

Path

Disallow

buzzsumo

Rule

Path

Disallow

bytespider

Rule

Path

Disallow

catexplorador

Rule

Path

Disallow

ccbot

Rule

Path

Disallow

code87

Rule

Path

Disallow

cshttp

Rule

Path

Disallow

calculon

Rule

Path

Disallow

cazoodlebot

Rule

Path

Disallow

cegbfeieh

Rule

Path

Disallow

censysinspect

Rule

Path

Disallow

chatgpt-user

Rule

Path

Disallow

cheteam

Rule

Path

Disallow

cheesebot

Rule

Path

Disallow

cherrypicker

Rule

Path

Disallow

chinaclaw

Rule

Path

Disallow

chlooe

Rule

Path

Disallow

citoid

Rule

Path

Disallow

claritybot

Rule

Path

Disallow

cliqzbot

Rule

Path

Disallow

cloud mapping

Rule

Path

Disallow

cocolyzebot

Rule

Path

Disallow

cogentbot

Rule

Path

Disallow

collector

Rule

Path

Disallow

copier

Rule

Path

Disallow

copyrightcheck

Rule

Path

Disallow

copyscape

Rule

Path

Disallow

cosmos

Rule

Path

Disallow

craftbot

Rule

Path

Disallow

crawling at home project

Rule

Path

Disallow

crazywebcrawler

Rule

Path

Disallow

crescent

Rule

Path

Disallow

crunchbot

Rule

Path

Disallow

curious

Rule

Path

Disallow

custo

Rule

Path

Disallow

cyotekwebcopy

Rule

Path

Disallow

dblbot

Rule

Path

Disallow

diibot

Rule

Path

Disallow

dsearch

Rule

Path

Disallow

dts agent

Rule

Path

Disallow

datacha0s

Rule

Path

Disallow

databasedrivermysqli

Rule

Path

Disallow

demon

Rule

Path

Disallow

deusu

Rule

Path

Disallow

devil

Rule

Path

Disallow

digincore

Rule

Path

Disallow

digitalpebble

Rule

Path

Disallow

dirbuster

Rule

Path

Disallow

disco

Rule

Path

Disallow

discobot

Rule

Path

Disallow

discoverybot

Rule

Path

Disallow

dispatch

Rule

Path

Disallow

dittospyder

Rule

Path

Disallow

dnbcrawler-analytics

Rule

Path

Disallow

dnyzbot

Rule

Path

Disallow

domcopbot

Rule

Path

Disallow

domainappender

Rule

Path

Disallow

domaincrawler

Rule

Path

Disallow

domainsigmacrawler

Rule

Path

Disallow

domainstatsbot

Rule

Path

Disallow

domains project

Rule

Path

Disallow

dotbot

Rule

Path

Disallow

download wonder

Rule

Path

Disallow

dragonfly

Rule

Path

Disallow

drip

Rule

Path

Disallow

eccp/1.0

Rule

Path

Disallow

email siphon

Rule

Path

Disallow

email wolf

Rule

Path

Disallow

easydl

Rule

Path

Disallow

ebingbong

Rule

Path

Disallow

ecxi

Rule

Path

Disallow

eirgrabber

Rule

Path

Disallow

erocrawler

Rule

Path

Disallow

evil

Rule

Path

Disallow

exabot

Rule

Path

Disallow

express webpictures

Rule

Path

Disallow

extlinksbot

Rule

Path

Disallow

extractor

Rule

Path

Disallow

geedoproductsearch

Rule

Path

Disallow

Other Records

Field

Value

sitemap

https://www.prophila.de/sitemap/sitemap.xml

Comments

Robots.txt file created by http://www.webtoolcentral.com
For domain: https://www.prophila.de
Baiduspider
Yandex

Warnings

18 invalid lines.

prophila.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

googlebot

googlebot-mobile

adsbot-google

googlebot-image

*

awariobot

imagesiftbot

facebookexternalhit

alibaba

etaospider

amazonbot

gptbot

bingbot

msnbot

seekportbot

turnitinbot

rogerbot

orangebot

semrushbot

xovibot

alphabot

nekstbot

mail.ru_bot

mediatookkitbot

surdotlybot

semrushbot

dotbot

memorybot

twengabot

webhistorybot

linkdexbot

psbot

istellabot

uptimebot

jobboersebot

youdaobot

naverbot

blexbot

exabot

ahrefsbot

cliqzbot

ahrefsbot

xovibot

seokicks

qwantify

mj12bot

bspider

jikespider

sogou

youdao

naver

yeti

moget

ichiro

paessler

kraken

ezooms

spbot

ia_archiver

yeti

istellabot

webcr/1.0

spamfilter

synapse

admantx

slurp

voila

mediatookkitbot

archive.org_bot

mail.ru

bnf.fr_bot

yacybot

stackrambler

phantom

fish

prophila.com
robots.txt