Log In Sign Up

hundeseite.de
robots.txt

Robots Exclusion Standard data for hundeseite.de

Resource Scan

Scan Details

Site Domain hundeseite.de
Base Domain hundeseite.de
Scan Status Ok
Last Scan2025-03-10T04:29:45+00:00
Next Scan 2025-03-17T04:29:45+00:00

Last Scan

Scanned2025-03-10T04:29:45+00:00
URL https://hundeseite.de/robots.txt
Domain IPs 194.24.160.85
Response IP 194.24.160.85
Found Yes
Hash 3e52b734f072ec00782ccb9555db642f3f238d032bdf8fd70015458d253efd3b
SimHash 6b3f08540ad8

Groups

*

Rule Path
Allow /*.js$
Allow /*.css$
Allow /wp-admin/admin-ajax.php
Allow /hundeforum/sitemap.php
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /trackback/
Disallow /*/feed/
Disallow /*/comments/
Disallow /kontakt/
Disallow /mitmachen/
Disallow /neue-hunderasse/
Disallow /hunderassen/bild-senden/
Disallow /impressum/
Disallow /hundeforum/help/
Disallow /hundeforum/search/
Disallow /hundeforum/galerie/users/
Disallow /hundeforum/galerie/tags/
Disallow /hundeforum/members/
Disallow /hundeforum/register/
Disallow /hundeforum/login/
Disallow /hundeforum/lost-password/
Disallow /hundeforum/groups/
Disallow /hundeforum/blog/
Disallow /hundeforum/search/
Disallow /hundeforum/xfa-blog-home/
Disallow /hundeforum/blog/
Disallow /hundeforum/xfa-blog-entry/
Disallow /hundeforum/xfa-blog-category/
Disallow /*?*
Disallow /*.php$

googlebot-image

Rule Path
Allow /
Disallow /hundeforum/
Disallow /hunderassen-bildtafel-bilder/
Disallow /wp-content/uploads/2021/10/
Disallow /*/thumbs/

mediapartners-google

Rule Path
Allow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

tapatalk

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

cliqzbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 180

hybridbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

a12

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amznkassocbot

Rule Path
Disallow /

askpeterbot

Rule Path
Disallow /

backlink-check

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

claritybot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

contentdetection

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

engine catalog crowler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

fastseek

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

friendfeedbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

htmlparser

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

infohelfer

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

java

Rule Path
Disallow /

kraken

Rule Path
Disallow /

linkchecker

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

linkman

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

miadev

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

monozilla

Rule Path
Disallow /

netestate

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ning/1.0

Rule Path
Disallow /

nutch

Rule Path
Disallow /

obot

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

oppo

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

pmoz

Rule Path
Disallow /

poster

Rule Path
Disallow /

procogbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

semager

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sibot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

socialayer

Rule Path
Disallow /

stan

Rule Path
Disallow /

steeler

Rule Path
Disallow /

suchmaschineninstitut

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

tencenttraveler

Rule Path
Disallow /

toplistbot

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wscheck

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yeti

Rule Path
Disallow /

y!j-brw

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.hundeseite.de/sitemap_index.xml
Back to top

Comments

  • Bots etwas langsamer
  • Bots draussen bleiben
Back to top

Warnings

  • 4 invalid lines.
Back to top