tvtoday.de
robots.txt

Robots Exclusion Standard data for tvtoday.de

Resource Scan

Scan Details

Site Domain tvtoday.de
Base Domain tvtoday.de
Scan Status Ok
Last Scan2026-01-15T23:33:34+00:00
Next Scan 2026-01-22T23:33:34+00:00

Last Scan

Scanned2026-01-15T23:33:34+00:00
URL https://tvtoday.de/robots.txt
Redirect https://www.tvtoday.de/robots.txt
Redirect Domain www.tvtoday.de
Redirect Base tvtoday.de
Domain IPs 193.26.108.196
Redirect IPs 193.26.108.196
Response IP 193.26.108.196
Found Yes
Hash 51b8e437d057c0f788b8c8fd115d23758a52f9f7824114ed3f25d16eb98b1c4a
SimHash 4834d9208d77

Groups

*

Rule Path
Allow /
Disallow /rss/
Disallow /programm/standard/sendung/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • GPTBot - OpenAI
  • ChatGPT - OpenAI
  • Common Crawl