die-antenne.at
robots.txt

Robots Exclusion Standard data for die-antenne.at

Resource Scan

Scan Details

Site Domain die-antenne.at
Base Domain die-antenne.at
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-17T19:36:04+00:00
Next Scan 2024-08-15T19:36:04+00:00

Last Successful Scan

Scanned2023-04-24T02:21:45+00:00
URL http://die-antenne.at/robots.txt
Domain IPs 78.142.129.7
Response IP 78.142.129.7
Found Yes
Hash 31f6bc92a38e8d70389539302d2151baed2145522aeb576f682e621e50c9d8e8
SimHash a9360812eac3

Groups

mfhttpscan

Rule Path
Disallow /

newspointbot

Rule Path
Disallow /

netsprint

Rule Path
Disallow /

*

Rule Path
Disallow /search*
Disallow /oe24plus/getPremiumContent/*
Disallow /oe24plus/api/getCoinRaisePayload/*

Other Records

Field Value
sitemap http://die-antenne.at/sitemapchannel.xml
sitemap http://die-antenne.at/sitemap-article.xml
sitemap http://die-antenne.at/sitemap-video.xml
sitemap http://die-antenne.at/sitemap-news.xml