img.morgenpost.de
robots.txt

Robots Exclusion Standard data for img.morgenpost.de

Resource Scan

Scan Details

Site Domain img.morgenpost.de
Base Domain morgenpost.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-05-21T19:46:54+00:00
Next Scan 2024-06-20T19:46:54+00:00

Last Successful Scan

Scanned2024-04-22T17:24:17+00:00
URL https://img.morgenpost.de/robots.txt
Domain IPs 195.201.211.8, 213.239.226.136, 213.239.228.180, 213.239.228.188, 2a01:4f8:c0:141c::1, 2a01:4f8:c0:1421::1, 2a01:4f8:c0:1440::1, 2a01:4f8:c0:2ba8::1
Response IP 213.239.226.136
Found Yes
Hash 509fe7386325b8da0928b40835e286f7bde38af24f923fa9d475e722a7a51360
SimHash ea7ef866bf42

Groups

*

Rule Path
Disallow /stats/*
Disallow /*?config*
Disallow /*.xmli*
Disallow /*?service=Ajax
Disallow /*?service=ajax
Disallow /mobil-schatten/*
Disallow /channelsextern/bmo_ipad/
Disallow /config/*
Disallow /test/*
Disallow /Test/*
Disallow /template/*
Disallow /*?*token=*
Disallow /*?*eventId=*
Disallow /static/*
Disallow /download/*.pdf
Disallow /archive/*.pdf
Disallow /gallery/gallery.php*
Disallow /extra/service*
Disallow /export/xml/*
Disallow /contents/ha/*
Disallow /fototool/*
Disallow /z/*
Disallow /chl/*
Disallow /tagesinhalt.html
Disallow /multimedia/archive/*
Disallow /ePaper/Document/*
Disallow /archiv/article.php*
Disallow /content/*
Disallow /misc/*
Disallow /desk/*
Disallow /ausgabe/*
Disallow /aboservice/lnk/*
Disallow /aboservice/dvd-edition/*
Disallow /*.pdf
Disallow /appl/newsticker2/*
Disallow /appl/forum/*
Disallow /appl/bildershow/*
Disallow /wonausallerwelt/*
Disallow /inhalt/berlin/*
Disallow /bm/inhalt/*
Disallow /arztsuche/*
Disallow /e-mail/*
Disallow /secure/
Disallow /socialmedia/*
Disallow *reader_id%3DREADER_ID*
Disallow /suche/*
Disallow /*?widgetid=
Disallow /newsletter-result/

cliqzbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

audisto

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.morgenpost.de/sitemaps/news.xml