Log In Sign Up

koi-community.de
robots.txt

Robots Exclusion Standard data for koi-community.de

Resource Scan

Scan Details

Site Domain koi-community.de
Base Domain koi-community.de
Scan Status Ok
Last Scan2025-03-11T12:26:01+00:00
Next Scan 2025-03-18T12:26:01+00:00

Last Scan

Scanned2025-03-11T12:26:01+00:00
URL https://koi-community.de/robots.txt
Domain IPs 80.74.158.110
Response IP 80.74.158.110
Found Yes
Hash 555f2f8d42794ae787b3505c5b69f6e2c7abb024e2a48ff11e1e4b689b3ff2e1
SimHash 6b32c8541ef1

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /feed/
Disallow /feed/comments/
Disallow /trackback/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Disallow /community/
Disallow /forum/*?*
Disallow /forum/account/
Disallow /forum/activity/
Disallow /forum/profile/
Disallow /forum/subscriptions/
Disallow /forum/members/
Disallow /*thumbs
Disallow /*?*
Disallow /*.php$

googlebot

Rule Path
Allow /*js*
Allow /*css*

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 200

a12

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amznkassocbot

Rule Path
Disallow /

askpeterbot

Rule Path
Disallow /

backlink-check

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

claritybot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

contentdetection

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

engine catalog crowler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

fastseek

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

friendfeedbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

htmlparser

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

infohelfer

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

java

Rule Path
Disallow /

kraken

Rule Path
Disallow /

linkchecker

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

linkman

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

miadev

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

monozilla

Rule Path
Disallow /

netestate

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ning/1.0

Rule Path
Disallow /

nutch

Rule Path
Disallow /

obot

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

oppo

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

pmoz

Rule Path
Disallow /

poster

Rule Path
Disallow /

procogbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

semager

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sibot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

socialayer

Rule Path
Disallow /

stan

Rule Path
Disallow /

steeler

Rule Path
Disallow /

suchmaschineninstitut

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

tencenttraveler

Rule Path
Disallow /

toplistbot

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wscheck

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yeti

Rule Path
Disallow /

y!j-brw

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://koi-community.de/forum/sitemap.xml
Back to top

Comments

  • No Email Crawler
Back to top

Warnings

  • 4 invalid lines.
Back to top