android-hilfe.de
robots.txt

Robots Exclusion Standard data for android-hilfe.de

Resource Scan

Scan Details

Site Domain android-hilfe.de
Base Domain android-hilfe.de
Scan Status Ok
Last Scan2025-12-22T12:36:13+00:00
Next Scan 2025-12-29T12:36:13+00:00

Last Scan

Scanned2025-12-22T12:36:13+00:00
URL https://android-hilfe.de/robots.txt
Domain IPs 212.72.171.241, 2a00:1f78:f012:1790::1:1
Response IP 212.72.171.241
Found Yes
Hash 3766530c9ec3d1686a2987269bc8ea43de3f52d54b86f41918c25adaf0a2839d
SimHash ba16d142ef82

Groups

*

Rule Path
Disallow /admin.php
Disallow /account/
Disallow /mitglied/
Disallow /conversations/
Disallow /login/
Disallow /register/
Disallow /lost-password/
Disallow /logout/
Disallow /search/*
Disallow /proxy.php
Disallow /whats-new/posts/*
Disallow /whats-new/latest-activity?before_id=*
Disallow /forum/informationen-fuer-neue-user-und-vorstellungen.4/
Disallow /forum/anregungen-zum.2/
Disallow /forum/alte-erledigte-anregungen.3458/

gptbot
oai-searchbot
anthropic-ai
claudebot
claude-web
claude-searchbot
applebot-extended
meta-externalagent
ccbot
img2dataset
petalbot
youbot
perplexitybot
perplexity-user
omgili
omgilibot
bytespider
magpie-crawler
diffbot
timpibot
iask.ai
velenpublicwebcrawler
meta-externalagent

Rule Path
Disallow /

baiduspider
amazonbot
yacybot
seznambot
seekport
coccocbot
mojeek
fleebs
yeti

Rule Path
Disallow /

ahrefsbot
semrushbot
semrushbot-ba
semrushbot-eo
semrushbot-esi
semrushbot-ft
semrushbot-ocob
semrushbot-si
semrushbot-swa
mj12bot
dotbot
seobilitybot
siteauditbot
blexbot
dataforseo
crawlerbot
barkrowler
rytebot
splitsignalbot
awariobot
trendictionbot
meltwaternews
neticle crawler
netvibes
noahbot
optimizer
pressenginebot
plagawarebot
blackbox exporter
prtg network monitor
qwarrybot
ai2bot
applenewsbot
pinterestbot
yandexmetrika
serankingbacklinksbot

Rule Path
Disallow /

archive.org_bot
internetarchive
heritrix
arquivo-web-crawler
iabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.android-hilfe.de/sitemap.php

Comments

  • Login / User-Bereiche
  • Foren, die nicht im Index sein muessen