Log In Sign Up

tagesspiegel.de
robots.txt

Robots Exclusion Standard data for tagesspiegel.de

Resource Scan

Scan Details

Site Domain tagesspiegel.de
Base Domain tagesspiegel.de
Scan Status Ok
Last Scan2024-09-20T05:09:23+00:00
Next Scan 2024-09-27T05:09:23+00:00

Last Scan

Scanned2024-09-20T05:09:23+00:00
URL https://tagesspiegel.de/robots.txt
Redirect https://www.tagesspiegel.de/robots.txt
Redirect Domain www.tagesspiegel.de
Redirect Base tagesspiegel.de
Domain IPs 104.16.212.228, 104.16.213.228, 2606:4700::6810:d4e4, 2606:4700::6810:d5e4
Redirect IPs 104.16.212.228, 104.16.213.228, 2606:4700::6810:d4e4, 2606:4700::6810:d5e4
Response IP 104.16.212.228
Found Yes
Hash 86dd6864646d0a70a2bb238c34191bb850889f5df96befd386006793527a840b
SimHash 2a280b5bcdf3

Groups

*

Rule Path
Disallow /community-comments
Disallow /wpsafelink.js

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.tagesspiegel.de/news.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_1996.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_1997.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_1998.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_1999.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2000.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2001.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2002.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2003.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2004.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2005.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2006.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2007.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2008.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2009.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2010.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2011.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2012.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2013.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2014.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2015.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2016.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2017.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2018.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2019.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2020.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2021.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2022.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2023.xml
sitemap https://www.tagesspiegel.de/contentexport/static/sitemap-index_2024.xml
Back to top

Comments

  • Legal notice: tagesspiegel.de expressly reserves the right to use its content for commercial text and data mining (ยง 44 b UrhG).
  • The use of robots or other automated means to access tagesspiegel.de or collect or mine data without
  • the express permission of tagesspiegel.de is strictly prohibited.
  • tagesspiegel.de may, in its discretion, permit certain automated access to certain tagesspiegel.de pages.
Back to top