Log In Sign Up

bild.de
robots.txt

Robots Exclusion Standard data for bild.de

Resource Scan

Scan Details

Site Domain bild.de
Base Domain bild.de
Scan Status Ok
Last Scan2024-11-14T00:33:12+00:00
Next Scan 2024-11-21T00:33:12+00:00

Last Scan

Scanned2024-11-14T00:33:12+00:00
URL https://bild.de/robots.txt
Redirect https://www.bild.de/robots.txt
Redirect Domain www.bild.de
Redirect Base bild.de
Domain IPs 145.243.240.20, 145.243.248.20
Redirect IPs 23.215.7.17, 23.215.7.25
Response IP 23.59.168.96
Found Yes
Hash 7bbb7ac22c11a9d47f643424d37e62644747b72d02c378345b352ec0f6b4eebc
SimHash 0836de564442

Groups

googlebot-news

Rule Path
Disallow /partner/
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

googlebot

Rule Path
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

googlebot-video

Rule Path
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

googlebot-image

Rule Path
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

mediapartners-google

Rule Path
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

lizard

Rule Path
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

bingbot

Rule Path
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

google-sitemaps

Rule Path
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

google_inspectiontool

Rule Path
Disallow /community/
Disallow /vorprod/
Disallow /test_stage/
Disallow /test/

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bild.de/sitemap-news.xml
sitemap https://www.bild.de/sitemap-video.xml
sitemap https://www.bild.de/sitemap-index.xml
sitemap https://www.bild.de/sitemap-category.xml
Back to top

Comments

  • Bei Fragen zu diesen Regeln oder Aenderungswuenschen koennen sie sich an das SEO-Team wenden, erreichbar unter 030 / 2591 79232
  • OpenAI ChatGPT
  • Google Bard
  • Common Crawl Foundation
  • Flamingo Search Engine
  • ClaudeBot
  • Anthropic AI
  • Claude-Web
  • Applebot-Extended
  • Magpie Crawler
  • IA Archiver
  • Omgili
  • OmgiliBot
  • Baidu Spider
  • Ahrefs Bot
  • DataForSeo Bot
  • Yeti
  • Semrush Bot
  • Senti Bot
  • MJ12 Bot
  • Byte Spider
  • Sirdata Bot
  • LCC
  • Turnitin Bot
  • BLEX Bot
  • Dot Bot
  • ImageSift Bot
  • Sitemaps
Back to top