global.handelsblatt.com
robots.txt

Robots Exclusion Standard data for global.handelsblatt.com

Resource Scan

Scan Details

Site Domain global.handelsblatt.com
Base Domain handelsblatt.com
Scan Status Ok
Last Scan2024-11-15T10:31:20+00:00
Next Scan 2024-11-22T10:31:20+00:00

Last Scan

Scanned2024-11-15T10:31:20+00:00
URL https://global.handelsblatt.com/robots.txt
Redirect https://www.handelsblatt.com/robots.txt
Redirect Domain www.handelsblatt.com
Redirect Base handelsblatt.com
Domain IPs 91.105.246.141
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash cfd06f2ce86e1b5919451ecf3f38d3096f8223945f8b658551b6d70ded363fd7
SimHash 839fea16c110

Groups

*

Rule Path
Disallow /preparesite/empty.js*
Disallow /cdn-cgi/beacon/performance*
Disallow /*/v_premium_not_allowed/*.html$
Disallow /*v_detail_tab_print*.html$
Disallow /*v_detail_tab_comments/*
Disallow /ajaxentry/
Disallow /*imagelightbox?elementId*
Disallow /user-registrierung/
Disallow /*%3Bjsessionid%3D*
Disallow /*jsessionid%3D*
Disallow /*action%3Dactivate*
Disallow /lesezeichen/
Disallow /registrierung/
Disallow /*?ajaxelementid=*
Disallow /*ajaxelementid%3D*
Disallow /*?view=print*
Disallow /*view%3Dprint*
Disallow /*?view=lightbox
Disallow /*view%3Dlightbox*
Disallow /channelizer/
Disallow /themen/my/*
Disallow /meine-news*
Disallow /api/*
Allow /api/content
Disallow */partials/htmlbox/*
Disallow */iframe_grafik.html*
Disallow */v_advertorial_detail/*
Disallow */amp-ivw.html*
Disallow */partials/related*
Disallow /cdn-cgi/rum*
Disallow /boerse/option/*
Disallow /boerse/zertifikat/*
Disallow /recommendation/hb_web/offerpage*
Disallow /cdn-cgi/

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.handelsblatt.com/news.xml
sitemap https://www.handelsblatt.com/contentexport/feed/sitemap/themen
sitemap https://www.handelsblatt.com/sitemapExternal/sitemaps_index.xml