hautarzt-cramer.de
robots.txt

Robots Exclusion Standard data for hautarzt-cramer.de

Resource Scan

Scan Details

Site Domain hautarzt-cramer.de
Base Domain hautarzt-cramer.de
Scan Status Ok
Last Scan2024-11-15T04:23:06+00:00
Next Scan 2024-12-15T04:23:06+00:00

Last Scan

Scanned2024-11-15T04:23:06+00:00
URL https://hautarzt-cramer.de/robots.txt
Domain IPs 2001:8d8:100f:f000::239, 217.160.0.232
Response IP 217.160.0.232
Found Yes
Hash 6eac1f7dc4db62810ac4126c567b89a285f2629d7e7e93be821f1b57972ca24f
SimHash c264f8aac9bb

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*/*.css
Allow /*/*.js
Disallow /wp-admin/
Disallow /author/
Disallow /login/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow *?attachment_id=
Disallow /?et_blog
Disallow /?page_id=*
Disallow /?avia_extended_shop_select=yes&product_order=*
Disallow /*?avia_extended_shop_select=*&product_order=*&product_sort=*
Disallow /?wg-choose-original=true
Disallow /?wg-choose-original=false
Disallow /*?wg-choose-original=*

*

Rule Path
Disallow /search/
Disallow /?s=
Disallow *?s=*
Disallow *?p=*
Disallow *%26p%3D*
Disallow *%26preview%3D*

*

Rule Path
Disallow /trackback/
Disallow */comments$
Disallow */trackback
Disallow */trackback$
Disallow /wp-comments
Disallow /wp-trackback
Disallow */replytocom%3D
Disallow /feed/
Disallow /feed/$
Disallow /comments/feed
Disallow */feed
Disallow */feed$
Disallow /?feed=
Disallow /wp-feed
Disallow /wp-json/
Disallow /?rest_route=

googlebot-image

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

bountiibot

Rule Path
Disallow /

bixo

Rule Path
Disallow /

bixocrawler

Rule Path
Disallow /

bixocrawler testcrawler

Rule Path
Disallow /

bixolabs/1.0

Rule Path
Disallow /

bubing

Rule Path
Disallow /

businessseek.biz_spider

Rule Path
Disallow /

buzzbot

Rule Path
Disallow /

buzzbot/1.0

Rule Path
Disallow /

camontspider/1.0

Rule Path
Disallow /

catchbot/1.0

Rule Path
Disallow /

catchbot/2.0

Rule Path
Disallow /

catchbot/3.0

Rule Path
Disallow /

catchbot/5.0

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

checksem/nutch-1.10

Rule Path
Disallow /

cisp vulnerability notification

Rule Path
Disallow /

cirrusexplorer/1.1

Rule Path
Disallow /

classbot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

crawlera/1.10.2

Rule Path
Disallow /

crowsnest/0.5

Rule Path
Disallow /

cukbot

Rule Path
Disallow /

custo

Rule Path
Disallow /

dataprovider/6.92

Rule Path
Disallow /

dataprovider/6.101

Rule Path
Disallow /

dataprovider site explorer

Rule Path
Disallow /

dataprovidersiteexplorer

Rule Path
Disallow /

dazoobot/1.0

Rule Path
Disallow /

dblbot/1.0

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

diffbot/0.1

Rule Path
Disallow /

digg deeper/v1

Rule Path
Disallow /

discobot/1.0

Rule Path
Disallow /

discobot/1.1

Rule Path
Disallow /

discobot/2.0

Rule Path
Disallow /

discoverybot/2.0

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

disco

Rule Path
Disallow /

dlvr.it/1.0

Rule Path
Disallow /

domainstatsbot/1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

download\ demon

Rule Path
Disallow /

drupact/0.7

Rule Path
Disallow /

dubaiindex

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

ecommercebot

Rule Path
Disallow /

eirgrabber

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

exabot

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

experibot_v1

Rule Path
Disallow /

fastbot crawler beta 2.0

Rule Path
Disallow /

fastbot crawler beta 4.0

Rule Path
Disallow /

feedbin

Rule Path
Disallow /

feedly/1.0

Rule Path
Disallow /

feedlybot/1.0

Rule Path
Disallow /

feedly social

Rule Path
Disallow /

feedspot

Rule Path
Disallow /

feedspotbot/1.0

Rule Path
Disallow /

ffbot/1.0

Rule Path
Disallow /

findlinks/1.0

Rule Path
Disallow /

findlinks/1.1.3-beta8

Rule Path
Disallow /

findlinks/1.1.3-beta9

Rule Path
Disallow /

findlinks/1.1.4-beta7

Rule Path
Disallow /

findlinks/1.1.6-beta1

Rule Path
Disallow /

findlinks/1.1.6-beta1 yacy

Rule Path
Disallow /

findlinks/1.1.6-beta2

Rule Path
Disallow /

findlinks/1.1.6-beta3

Rule Path
Disallow /

findlinks/1.1.6-beta4

Rule Path
Disallow /

findlinks/1.1.6-beta5

Rule Path
Disallow /

findlinks/1.1.6-beta6

Rule Path
Disallow /

findlinks/2.0

Rule Path
Disallow /

findlinks/2.0.1

Rule Path
Disallow /

findlinks/2.0.2

Rule Path
Disallow /

findlinks/2.0.4

Rule Path
Disallow /

findlinks/2.0.5

Rule Path
Disallow /

findlinks/2.0.9

Rule Path
Disallow /

findlinks/2.1

Rule Path
Disallow /

findlinks/2.1.3

Rule Path
Disallow /

findlinks/2.1.5

Rule Path
Disallow /

findlinks/2.2

Rule Path
Disallow /

findlinks/2.5

Rule Path
Disallow /

findlinks/2.6

Rule Path
Disallow /

focusbot/1.1

Rule Path
Disallow /

fyberspider/1.3

Rule Path
Disallow /

g2reader-bot/1.0

Rule Path
Disallow /

genieo

Rule Path
Disallow /

giftghostbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

huaweisymantecspider/1.0

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

lemurwebcrawler

Rule Path
Disallow /

lipperheylinkexplorer

Rule Path
Disallow /

lssrocketcrawler/1.0

Rule Path
Disallow /

lyt.srv1.5

Rule Path
Disallow /

miadev/0.0.1

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

najdi.si/3.1

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

netspider

Rule Path
Disallow /

pagegrabber

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seznam

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sosospider+

Rule Path
Disallow /

sosospider/2.0

Rule Path
Disallow /

superbot

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yodao

Rule Path
Disallow /

youdao

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

youdaobot/1.0

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /%5E

core

Rule Path
Disallow /%5E

Other Records

Field Value
sitemap https://hautarzt-cramer.de/sitemap_index.xml

Comments

  • Block Search Parameters
  • Block Spam | Feed | JSON API
  • Block Bots

Warnings

  • 8 invalid lines.