Log In Sign Up

antenne-io.de
robots.txt

Robots Exclusion Standard data for antenne-io.de

Resource Scan

Scan Details

Site Domain antenne-io.de
Base Domain antenne-io.de
Scan Status Ok
Last Scan2025-12-22T02:41:20+00:00
Next Scan 2025-12-29T02:41:20+00:00

Last Scan

Scanned2025-12-22T02:41:20+00:00
URL https://antenne-io.de/robots.txt
Redirect https://www.antenne-kh.de/robots.txt
Redirect Domain www.antenne-kh.de
Redirect Base antenne-kh.de
Domain IPs 2001:8d8:100f:f000::23b, 217.160.0.37
Redirect IPs 79.142.46.174
Response IP 79.142.46.174
Found Yes
Hash 18b2974d1063e5517ed418b2ce62304c5b0f6e0308fb2f88a36d178c5291fd23
SimHash 8f860700e117

Groups

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=
Disallow /wp-content/uploads/wp-import-export-lite/
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/

googlebot-news

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
crawl-delay 2

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.antenne-kh.de/sitemap_index.xml
sitemap https://www.antenne-kh.de/news-sitemap.xml
Back to top

Comments

  • =====================================================
  • robots.txt – optimiert für Google News & Discover
  • Erstellt für: antenne-kh.de
  • Stand: Oktober 2025
  • Entwickelt von Daniel KLein
  • =====================================================
  • --------------------------------------------
  • Standard-Crawler (alle Bots)
  • --------------------------------------------
  • Erlaube Crawling wichtiger Ressourcen (CSS, JS, Bilder)
  • --------------------------------------------
  • Googlebot-News (spezieller Crawler für Google News)
  • --------------------------------------------
  • --------------------------------------------
  • Googlebot-Image (Bildersuche & Discover-Thumbnails)
  • --------------------------------------------
  • --------------------------------------------
  • Googlebot-Mobile (Mobile First Index)
  • --------------------------------------------
  • --------------------------------------------
  • Microsoft Bing & andere Bots
  • --------------------------------------------
  • --------------------------------------------
  • Sitemaps (klar getrennt aufgeführt)
  • --------------------------------------------
  • =====================================================
  • Hinweise:
  • - news-sitemap.xml wird täglich automatisch aktualisiert (Yoast)
  • - Crawl-Delay optimiert Serverlast bei News-Traffic
  • - CSS/JS/Images explizit freigegeben für korrektes Rendering
  • =====================================================
Back to top