markt.hna.de
robots.txt

Robots Exclusion Standard data for markt.hna.de

Resource Scan

Scan Details

Site Domain markt.hna.de
Base Domain hna.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-27T21:01:18+00:00
Next Scan 2024-10-25T21:01:18+00:00

Last Successful Scan

Scanned2023-09-25T20:56:24+00:00
URL https://markt.hna.de/robots.txt
Domain IPs 85.236.47.181
Response IP 85.236.47.181
Found Yes
Hash bfc27308ad06df045130af126eeabbdf235ae5623b4ac1ccf06f0bbb3f6fe691
SimHash a8d758cacef3

Groups

*

Rule Path
Disallow *.ajx
Disallow *.drawWidgetEntriesCallback
Disallow */img_placeholder_lazyload.svg
Disallow */shop.htm
Disallow *ajaxCall
Disallow /11893755/
Disallow /admin/
Disallow /facebook/
Disallow */importeurKarte.htm
Disallow */kartensuche.htm
Disallow /*?*contactFlow=

adsbot-google

Rule Path
Disallow /*/crc%2C*.htm$

mediapartners-google

Rule Path
Disallow /*/crc%2C*.htm$

crystalsemanticsbot

Rule Path
Disallow /

doc

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

httrack

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linko

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zao

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.markt.de/sitemap_index.xml