shop24.at
robots.txt

Robots Exclusion Standard data for shop24.at

Resource Scan

Scan Details

Site Domain shop24.at
Base Domain shop24.at
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-08T21:01:24+00:00
Next Scan 2024-07-07T21:01:24+00:00

Last Successful Scan

Scanned2022-04-20T10:49:49+00:00
URL http://shop24.at/robots.txt
Redirect https://www.oe24.at/robots.txt
Redirect Domain www.oe24.at
Redirect Base oe24.at
Response IP 34.117.46.205
Found Yes
Hash bd586823d095078b2432264d341aea50dee677f3ca291e142abfedd2ca32d220
SimHash 9a140816cf33

Groups

mfhttpscan

Rule Path
Disallow /

newspointbot

Rule Path
Disallow /

netsprint

Rule Path
Disallow /

*

Rule Path
Disallow /test/*
Disallow /anzeige/*
Disallow /search*
Disallow /oe24plus/getPremiumContent/*
Disallow /oe24plus/api/getCoinRaisePayload/*
Disallow /gutscheine/suche?
Disallow /gutscheine/*?code=*
Disallow /gutscheine/*%26code%3D*

Other Records

Field Value
sitemap https://www.oe24.at/sitemapchannel.xml
sitemap https://www.oe24.at/sitemap-article.xml
sitemap https://www.oe24.at/sitemap-video.xml
sitemap https://www.oe24.at/sitemap-news.xml
sitemap https://www.oe24.at/gutscheine/sitemap.xml