preis.de
robots.txt

Robots Exclusion Standard data for preis.de

Resource Scan

Scan Details

Site Domain preis.de
Base Domain preis.de
Scan Status Ok
Last Scan2024-06-13T12:22:57+00:00
Next Scan 2024-06-20T12:22:57+00:00

Last Scan

Scanned2024-06-13T12:22:57+00:00
URL https://preis.de/robots.txt
Redirect https://www.preis.de/robots.txt
Redirect Domain www.preis.de
Redirect Base preis.de
Domain IPs 130.117.178.34
Redirect IPs 130.117.178.34
Response IP 130.117.178.34
Found Yes
Hash 046ab9a368395a51a717c1f21ef2256f7678e918afa4e56d9ddcfaef623972e2
SimHash 411c50f0c591

Groups

ahrefsbot

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /opener_out.htm

adsbot-google

Rule Path
Disallow /opener_out.htm

adsbot-google-mobile

Rule Path
Disallow /opener_out.htm

archive.org_bot

Rule Path
Disallow /opener_out.htm

audisto

Rule Path
Disallow /opener_out.htm
Disallow /gutscheine/

audisto-essential

Rule Path
Disallow /opener_out.htm

bingbot

Rule Path
Disallow /opener_out.htm

duckduckbot

Rule Path
Disallow /opener_out.htm

exabot

Rule Path
Disallow /opener_out.htm

googlebot

Rule Path
Disallow /opener_out.htm

ia_archiver

Rule Path
Disallow /opener_out.htm

insitesbot

Rule Path
Disallow /opener_out.htm

mediapartners-google

Rule Path
Disallow /opener_out.htm

sistrix bot

Rule Path
Disallow /opener_out.htm

special_archiver

Rule Path
Disallow /opener_out.htm

yahoo! slurp

Rule Path
Disallow /opener_out.htm

yandex

Rule Path
Disallow /opener_out.htm

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.preis.de/g_sitemap/sitemap_index.xml