tivi.de
robots.txt

Robots Exclusion Standard data for tivi.de

Resource Scan

Scan Details

Site Domain tivi.de
Base Domain tivi.de
Scan Status Ok
Last Scan2024-06-03T17:16:36+00:00
Next Scan 2024-07-03T17:16:36+00:00

Last Scan

Scanned2024-06-03T17:16:36+00:00
URL https://www.tivi.de/robots.txt
Redirect https://www.zdf.de/robots.txt
Redirect Domain www.zdf.de
Redirect Base zdf.de
Domain IPs 104.68.82.208
Redirect IPs 104.68.82.208
Response IP 23.54.137.157
Found Yes
Hash 769c0051b51604acf37f67b2ec46c6d1e09a58ab9a509d2d9d050a1ea0083f0b
SimHash 722503443db0

Groups

ccbot
google-extended
gptbot
chatgpt-user
scrapy
scrapybot
semrushbot
sentibot
seokicks-robot
tkbot
trendkite-akashic-crawler
vagabondo
wbsearchbot
grapeshot
icjobs
linkdexbot
magpie-crawler
megaindex
mj12bot
proximic
queryseekerspider

Rule Path
Disallow /sport/bundesliga/

Other Records

Field Value
sitemap https://www.zdf.de/sitemap.xml
sitemap https://www.zdf.de/news-sitemap.xml