postbau.de
robots.txt

Robots Exclusion Standard data for postbau.de

Resource Scan

Scan Details

Site Domain postbau.de
Base Domain postbau.de
Scan Status Ok
Last Scan2026-02-13T06:42:56+00:00
Next Scan 2026-03-15T06:42:56+00:00

Last Scan

Scanned2026-02-13T06:42:56+00:00
URL https://postbau.de/robots.txt
Domain IPs 2a03:4000:61:4ceb::18:6911, 91.204.46.61
Response IP 91.204.46.61
Found Yes
Hash e3d3df237c6f7bed1824df1ccd52e98da3183458b2815df1b6c01fb1c721c78d
SimHash 5b145960a963

Groups

*

Rule Path
Disallow

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

openai-discord

Rule Path
Disallow /

Comments

  • Blockierung von KI-Crawlern