Log In Sign Up

kreiter.info
robots.txt

Robots Exclusion Standard data for kreiter.info

Resource Scan

Scan Details

Site Domain kreiter.info
Base Domain kreiter.info
Scan Status Ok
Last Scan2025-11-29T00:04:46+00:00
Next Scan 2025-12-06T00:04:46+00:00

Last Scan

Scanned2025-11-29T00:04:46+00:00
URL https://kreiter.info/robots.txt
Redirect https://www.kreiter.info/robots.txt
Redirect Domain www.kreiter.info
Redirect Base kreiter.info
Domain IPs 2001:8d8:100f:f000::208, 217.160.0.123
Redirect IPs 2001:8d8:100f:f000::208, 217.160.0.123
Response IP 217.160.0.123
Found Yes
Hash 7743fc22e919c3369bc1f56fbe1e809283ff2666191c231c79fc3617ad5e9aa9
SimHash 701859c1c8b0

Groups

*

Rule Path
Allow /

picsearchbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webmirror

Rule Path
Disallow /

webcopy

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applewebkit

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

binance.com

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

youbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

googleother

Rule Path
Allow /

googleotherimage

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.kreiter.info/sitemap-new.xml
Back to top

Comments

  • robots.txt for www.kreiter.info/
  • Zugriff für Massendownloader verbieten
Back to top