juwelier-roller.de
robots.txt

Robots Exclusion Standard data for juwelier-roller.de

Resource Scan

Scan Details

Site Domain juwelier-roller.de
Base Domain juwelier-roller.de
Scan Status Ok
Last Scan2024-09-05T14:34:30+00:00
Next Scan 2024-10-05T14:34:30+00:00

Last Scan

Scanned2024-09-05T14:34:30+00:00
URL https://juwelier-roller.de/robots.txt
Redirect https://www.juwelier-roller.de/robots.txt
Redirect Domain www.juwelier-roller.de
Redirect Base juwelier-roller.de
Domain IPs 75.2.60.5
Redirect IPs 13.228.199.255, 2406:da18:880:3800::c8, 2406:da18:b3d:e201::64, 52.74.166.77
Response IP 13.215.144.61
Found Yes
Hash ed8a20bb4800f04630a6a2de01049e665adb0ceaa30ccd388e885def8be2127b
SimHash 4b477d7cc691

Groups

*

Rule Path
Disallow /kontakt/
Disallow /produktanfrage/
Disallow /produkt-detektiv/
Disallow /suche/
Disallow /customer/
Disallow /wishlist/

slurp

Rule Path
Disallow /

seokicks
seokicks-robot

Rule Path
Disallow /

yandexbot
yandexdirect
yandexdirectdyn
yandexmedia
yadirectfetcher
yandexblogs
yandexnews
yandexpagechecker
yandexmetrika
yandexcalendar

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

mail.ru_bot
mail.ru

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru/2.0
megaindex.ru
megaindex.ru
megaindex.ru
megaindex.com

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.juwelier-roller.de/sitemap-index.xml

Warnings

  • `host` is not a known field.