Log In Sign Up

laduti.de
robots.txt

Robots Exclusion Standard data for laduti.de

Resource Scan

Scan Details

Site Domain laduti.de
Base Domain laduti.de
Scan Status Ok
Last Scan2025-09-16T18:18:28+00:00
Next Scan 2025-10-16T18:18:28+00:00

Last Scan

Scanned2025-09-16T18:18:28+00:00
URL https://laduti.de/robots.txt
Domain IPs 104.21.25.7, 172.67.221.136, 2606:4700:3036::6815:1907, 2606:4700:3037::ac43:dd88
Response IP 104.21.25.7
Found Yes
Hash 4d9ca2cde18546c79fd233ee5e368c5ff877930c093e2bf9e4d71b70c541cee0
SimHash 7a826800ccfa

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

oai-searchbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

bing-extended

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

bytespider

Rule Path
Allow /

ccbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://laduti.de/sitemap_index.xml
Back to top

Comments

  • Allgemein: alle Bots erlaubt, außer sensible technische Verzeichnisse
  • OpenAI ChatGPT Crawler
  • Google AI / SGE / Bard (nutzt Googlebot + Google-Extended)
  • Bing Chat / Copilot
  • Perplexity AI (z. B. bei „ppl-bot“)
  • Andere häufige KI-Bots
Back to top