juwelier-roller.de
robots.txt

Robots Exclusion Standard data for juwelier-roller.de

Resource Scan

Scan Details

Site Domain juwelier-roller.de
Base Domain juwelier-roller.de
Scan Status Ok
Last Scan2024-11-04T14:35:08+00:00
Next Scan 2024-12-04T14:35:08+00:00

Last Scan

Scanned2024-11-04T14:35:08+00:00
URL https://juwelier-roller.de/robots.txt
Redirect https://www.juwelier-roller.de/robots.txt
Redirect Domain www.juwelier-roller.de
Redirect Base juwelier-roller.de
Domain IPs 75.2.60.5
Redirect IPs 2406:da18:b3d:e200::65, 2406:da18:b3d:e201::65, 52.220.155.145, 52.74.232.59
Response IP 52.220.155.145
Found Yes
Hash ed8a20bb4800f04630a6a2de01049e665adb0ceaa30ccd388e885def8be2127b
SimHash 4b477d7cc691

Groups

*

Rule Path
Disallow /kontakt/
Disallow /produktanfrage/
Disallow /produkt-detektiv/
Disallow /suche/
Disallow /customer/
Disallow /wishlist/

slurp

Rule Path
Disallow /

seokicks
seokicks-robot

Rule Path
Disallow /

yandexbot
yandexdirect
yandexdirectdyn
yandexmedia
yadirectfetcher
yandexblogs
yandexnews
yandexpagechecker
yandexmetrika
yandexcalendar

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

mail.ru_bot
mail.ru

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru/2.0
megaindex.ru
megaindex.ru
megaindex.ru
megaindex.com

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.juwelier-roller.de/sitemap-index.xml

Warnings

  • `host` is not a known field.