mainfranken.markt.de
robots.txt

Robots Exclusion Standard data for mainfranken.markt.de

Resource Scan

Scan Details

Site Domain mainfranken.markt.de
Base Domain markt.de
Scan Status Ok
Last Scan2024-05-17T09:40:06+00:00
Next Scan 2024-05-31T09:40:06+00:00

Last Scan

Scanned2024-05-17T09:40:06+00:00
URL https://mainfranken.markt.de/robots.txt
Domain IPs 62.116.173.122, 85.236.47.180
Response IP 62.116.173.122
Found Yes
Hash bfc27308ad06df045130af126eeabbdf235ae5623b4ac1ccf06f0bbb3f6fe691
SimHash a8d758cacef3

Groups

*

Rule Path
Disallow *.ajx
Disallow *.drawWidgetEntriesCallback
Disallow */img_placeholder_lazyload.svg
Disallow */shop.htm
Disallow *ajaxCall
Disallow /11893755/
Disallow /admin/
Disallow /facebook/
Disallow */importeurKarte.htm
Disallow */kartensuche.htm
Disallow /*?*contactFlow=

adsbot-google

Rule Path
Disallow /*/crc%2C*.htm$

mediapartners-google

Rule Path
Disallow /*/crc%2C*.htm$

crystalsemanticsbot

Rule Path
Disallow /

doc

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

httrack

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linko

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zao

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.markt.de/sitemap_index.xml