apps.mediaz.de
robots.txt

Robots Exclusion Standard data for apps.mediaz.de

Resource Scan

Scan Details

Site Domain apps.mediaz.de
Base Domain mediaz.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-23T12:31:03+00:00
Next Scan 2026-02-21T12:31:03+00:00

Last Successful Scan

Scanned2025-07-04T05:30:14+00:00
URL https://apps.mediaz.de/robots.txt
Domain IPs 217.154.71.244, 2a01:239:3ac:d100::1
Response IP 217.154.71.244
Found Yes
Hash 16dba021d3fb274d49aa2a4ae6dc124699ad4192be4a0f0be0038693b69f68df
SimHash 58364168668e

Groups

*

Rule Path
Disallow /public/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

genomecrawlerd

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

adstxtcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

webprosbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexrenderresourcesbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

repolookoutbot
wellknownbot
seekportbot
obot
inetdex-bot
neevabot
yandexfavicons
mindupbot
megaindex.ru
macocu
iframely
semanticscholarbot
pixalate.com
implisensebot
ioncrawl
domainstatsbot
domaincrawler
velenpublicwebcrawler
coccocbot-web
coccocbot-image
serpstatbot
seekportbot
fluid
netestate ne crawler
dataforseobot
mojeekbot
pandalytics
zoominfobot
dmbot
ev-crawler
seekportbot
surdotlybot
baiduspider
yisouspider
lightspeedsystemscrawler
internetmeasurement

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

Warnings

  • 3 invalid lines.