testberichte.de
robots.txt

Robots Exclusion Standard data for testberichte.de

Resource Scan

Scan Details

Site Domain testberichte.de
Base Domain testberichte.de
Scan Status Ok
Last Scan2024-06-20T22:12:32+00:00
Next Scan 2024-06-27T22:12:32+00:00

Last Scan

Scanned2024-06-20T22:12:32+00:00
URL https://testberichte.de/robots.txt
Domain IPs 62.146.104.29
Response IP 62.146.104.29
Found Yes
Hash 85d911eebe971c9506aecc28405997f096be015d26b527c2f421d9ee347df026
SimHash 1015bf60d848

Groups

*

Rule Path
Disallow /c/
Disallow /d/
Disallow /ad/
Disallow /f/
Disallow /fx/
Disallow /px/
Disallow /t/
Disallow /b/
Disallow /m/
Disallow /mobile/
Disallow /r/datenblatt/
Disallow /r/meinung/neue-meinung.html
Disallow /r/preis-sieger/
Disallow /r/test-note/
Disallow /r/test-sieger/
Disallow /volltextsuche/
Disallow /ratgeber/
Disallow /article/
Disallow /gu/
Disallow /d/ajax/
Disallow /dimg/
Disallow /limg/
Disallow /djs/
Disallow /js/v3/
Disallow /css/v3/
Disallow /search/
Disallow /pm/
Allow /css/v3/index-all.css
Allow /css/v3/lvl2.css
Allow /css/v3/lvl3-all.css
Allow /css/v3/root-all.css
Allow /css/v3/lvl5-all.css
Allow /css/v3/lvl5product-all.css
Allow /css/v3/lvl5_opinion.css
Allow /css/v3/public-relations.css
Allow /css/v3/magazine-list-page.css
Allow /css/v3/magazine-page.css
Allow /css/v3/lvl4-review-all.css
Allow /css/v3/presse.css
Allow /css/v3/root-all_.css
Disallow /imgs/editors/
Disallow /pxr/
Disallow /js/v5/nfl/
Disallow /css/v5/nfl/
Disallow /css/v4/nfl/
Disallow /js/v4/nfl/
Disallow /js/v4/jquery/
Allow /js/v4/jquery/jquery-1.9.0.min.js
Allow /js/v3/mobileswitch.min.js
Disallow /beta/
Disallow /downloads/
Allow /downloads/nl/
Allow /downloads/pdf/
Disallow /img-v3/press/
Allow /img-v3/press/logo_print.jpg
Disallow /img-v3/pr/
Disallow /img-v3/employee/
Disallow /partner/
Disallow /api/
Disallow /app/
Disallow /captcha/
Disallow /secure/
Allow /dimg/note*
Disallow /www/imgs/
Disallow /www/files/
Disallow /imgsrv/
Allow /css/v3/mobile.css

aipbot

Rule Path
Disallow /

qihoobot 1.0

Rule Path
Disallow /

mediapartners-google*

Rule Path
Allow /ad/
Disallow /d/so/
Disallow /mobile/

shopwiki

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

iisbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

custo 3.0 (www.netwu.com)

Rule Path
Disallow /

custo 3 (netwu.com)

Rule Path
Disallow /

scrapy*

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

newspointbot/1.0 (http://www.netsprint.eu/)

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

abonti

Rule Path
Disallow /

buibui-bot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

zyklop

Rule Path
Disallow /

bubing

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

jsoup

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

admantx platform semantic analyzer

Rule Path
Disallow /

qcrawl

Rule Path
Disallow /

bhcbot

Rule Path
Disallow /

getintentcrawler

Rule Path
Disallow /

onpagebot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

magentanews

Rule Path
Disallow /

Comments

  • v5 (TB2) syntax
  • v4 syntax
  • for google mobile-friendly
  • allow for schema attributes
  • Disallow: /files/
  • for mobile desktop version
  • User-agent: MJ12bot
  • Disallow:
  • User-agent: AhrefsBot
  • Disallow: