rechtslupe.de
robots.txt

Robots Exclusion Standard data for rechtslupe.de

Resource Scan

Scan Details

Site Domain rechtslupe.de
Base Domain rechtslupe.de
Scan Status Ok
Last Scan2025-03-30T13:56:45+00:00
Next Scan 2025-04-13T13:56:45+00:00

Last Scan

Scanned2025-03-30T13:56:45+00:00
URL https://rechtslupe.de/robots.txt
Redirect https://www.rechtslupe.de/robots.txt
Redirect Domain www.rechtslupe.de
Redirect Base rechtslupe.de
Domain IPs 185.245.99.134
Redirect IPs 185.245.99.134
Response IP 185.245.99.134
Found Yes
Hash e063db97a1766b2dd6262a38576f80197025d344881564e3d8b20be67195dc79
SimHash 580419019ed7

Groups

agentic
ai article writer
ai content detector
ai dungeon
ai search engine
ai seo crawler
ai writer
ai21 labs
ai2bot
aibot
aimatrix
aisearchbot
ai training
aitraining
alexa
alpha ai
alphaai
amazon bedrock
amazon-kendra
amazon lex
amazon comprehend
amazon sagemaker
amazon silk
amazon textract
amazonbot
amelia
anderspinkbot
anypicker
anyword
applebot
aria browse
articoolo
automated writer
awariorssbot
awariosmartbot
brave leo
bytedance
bytespider
catboost
cc-crawler
ccbot
chatglm
chinchilla
clearscope
cohere
common crawl
commoncrawl
content harmony
content king
content optimizer
content samurai
contentatscale
contentbot
contentedge
conversion ai
copilot
copyai
copymatic
copyscape
cotoyogi
crawlq ai
crawlspace
crew ai
crewai
dall-e
dataforseobot
dataprovider
deepai
deepl
deepmind
deepseek
diffbot
doubao ai
duckassistbot
facebookbot
facebookexternalhit
firecrawl
flyriver
frase ai
friendlycrawler
gemma
genai
google-cloudvertexbot
goose
gpt
grendizer
grok
gt bot
gtbot
hemingway editor
hugging face
hypotenuse ai
iaskspider
icc-crawler
imagesiftbot
img2dataset
ink editor
inkforall
intelliseek
inferkit
isscyberriskcrawler
kafkai
kangaroo
keyword density ai
komobot
llama
magpie-crawler
marketmuse
meltwater
meta ai
meta-ai
meta-external
metaai
metatagbot
narrative
neevabot
neural text
neuralseo
oai-searchbot
omgili
openbot
opentext ai
outwrite
page analyzer ai
pangubot
paperlibot
paraphraser.io
petalbot
phindbot
piplbot
prowritingaid
quillbot
robotspider
rytr
saplingai
scalenut
scraper
scrapy
scriptbook
seo content machine
seo robot
sentibot
sidetrade
simplified ai
skydancer
slickwrite
spin rewriter
spinbot
stability
stablediffusionbot
sudowrite
surfer ai
text blaze
textcortex
the knowledge ai
timpibot
vidnami ai
webzio
wordai
wordtune
wormsgtp
wpbot
writecream
writerzen
writescope
writesonic
xai
xbot
youbot
zero gtp
zerochat
zimm

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole

Other Records

Field Value
sitemap https://www.rechtslupe.de/sitemaps.xml

Comments

  • robots.txt
  • KI-Bots aussperren
  • robots.txt

Warnings

  • 1 invalid line.