mdr.de
robots.txt
Robots Exclusion Standard data for mdr.de
Resource Scan
Scan Details
Site Domain | mdr.de |
Base Domain | mdr.de |
Scan Status | Ok |
Last Scan | 2025-08-03T15:00:09+00:00 |
Next Scan | 2025-09-02T15:00:09+00:00 |
Last Scan
Scanned | 2025-08-03T15:00:09+00:00 |
URL | https://mdr.de/robots.txt |
Redirect | https://www.mdr.de/robots.txt |
Redirect Domain | www.mdr.de |
Redirect Base | mdr.de |
Domain IPs | 193.22.36.128 |
Redirect IPs | 104.81.108.72 |
Response IP | 184.30.132.193 |
Found | Yes |
Hash | 51d0dffe41bd2e42dc0935cad6748f3e6c947f970a0126707f7644291f398bef |
SimHash | 7f5ec91087d4 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.xml$ |
Disallow | /404/ |
Disallow | /administratives/ |
Disallow | /export/ |
Disallow | /forum/ |
Disallow | /kultur/rueckblick/ |
Disallow | /medienproduktion/ |
Disallow | /schulung/ |
Disallow | /test/ |
Disallow | /*-shorturl.json$ |
Disallow | /*-shorturl*.json$ |
Disallow | /*~fbia.html$ |
Disallow | /mediathek/mediathek-suche--100_zc-*.html* |
Disallow | /mediathek/suche/mediathek-suche--100-default.html?* |
Disallow | /mediathek/audio-app/ |
Disallow | /video/audio-app/ |
Disallow | /resources/global/player/embed/ |
Disallow | /mediathek/verbreitung/portal/ |
Disallow | /video/verbreitung/portal/ |
Disallow | /yourls/ |
Disallow | /scripts4/ |
Disallow | /chat/login.php |
Disallow | /CONT/teletext/* |
Disallow | /quizzes/ |
Allow | /scripts4/tippspiel/$ |
Allow | /*-podcast.xml$ |
Allow | /*-rss.xml$ |
Allow | /*-avFeed.xml$ |
Allow | /*-sitemap.xml$ |
Allow | /video/administratives/newestvideositemap-100-mediaRss.xml$ |
Allow | /video/administratives/newestaudiositemap-100-mediaRss.xml$ |
Allow | /sitemap-index-100.xml |
Allow | /administratives/*.css |
Allow | /administratives/*.js |
Allow | /administratives/*.png |
Allow | /administratives/*.jpg |
Other Records
Field | Value |
---|---|
sitemap | https://www.mdr.de/news-sitemap.xml |
sitemap | https://www.mdr.de/sitemap-index-100.xml |
Comments