olightstore.de
robots.txt

Robots Exclusion Standard data for olightstore.de

Resource Scan

Scan Details

Site Domain olightstore.de
Base Domain olightstore.de
Scan Status Ok
Last Scan2024-09-28T13:50:51+00:00
Next Scan 2024-10-28T13:50:51+00:00

Last Scan

Scanned2024-09-28T13:50:51+00:00
URL https://www.olightstore.de/robots.txt
Domain IPs 108.157.254.100, 108.157.254.16, 108.157.254.51, 108.157.254.91
Response IP 108.157.254.51
Found Yes
Hash 97d12ee9446551fed37ae5198b404176ed2301b0af4e44173e1bacebbda070c6
SimHash e176105b9dde

Groups

googlebot

Rule Path
Disallow /dog-pack.html
Disallow /dog-food-bag.html
Disallow /dog-boots.html
Disallow /bowl.html
Disallow /dog-harness.html
Disallow /dog-leash.html
Disallow /dog-sleeping-pad.html
Disallow /omug-enamel-360-wt01.html
Disallow /omug-enamel-360-bk01.html
Disallow /markting.html*
Disallow /*.html*page%3D*
Disallow /garantie/*
Disallow /review/product/
Disallow /?olinkid*
Disallow /?ref*
Disallow /?wbraid
Disallow /user
Disallow /error
Disallow /pay
Disallow /cart
Disallow /register
Disallow /invalidation.html
Disallow /catalogsearch/result/*q%3D*
Disallow /banktransfer.html$
Disallow /*tracking%3D*
Disallow /bottomBar/contactUs.html*
Disallow /detail.html*productId%3D*
Disallow /blog.html*blogLabelId%3D*
Disallow /aftersales.html
Disallow /*gift.html$
Disallow /product.html*id%3D*
Disallow /search.html*keyword%3D*
Disallow /catalog/
Disallow /catalogsearch/result/*
Disallow /en/*
Disallow /taschenlampe-zubeh-r/*
Disallow /ads.txt
Disallow /taschenlampen-fur-den-harten-einsatz/*
Disallow /search/*.html$
Disallow /flash-sales/*.html
Disallow /%22%22/*
Disallow /alltag-edc-everyday-carry/*.html$
Disallow /home-best/*.html$
Disallow /all-products/*
Disallow /ov/*
Disallow /static/version*/*
Disallow /camping-outdoor/*.html$
Disallow /*awc%3D*
Disallow /olight-gear/*.html$
Disallow /best-seller/*.html$
Disallow /led-taschenlampen/*
Disallow /akkus-ladegerate/*
Disallow /led-taschenlampen-stirnlampe-kopflampe/*.html$
Disallow /produkte/*.html$
Disallow /olight-h-Serien/*
Disallow /black-friday/*
Disallow /produkte/*.html$
Disallow /taschenlampe/*.html$
Disallow /undefined
Disallow /olight-s-Serien*sort%3D*
Disallow /olight-s-Serien/*
Disallow /12-02-00-00-00-12-03-00-00-00/*
Disallow /12-17-00-00-00-12-31-00-00-00/*
Disallow /taschenlampen-zubehor/*
Disallow /olight-m-Serien/*
Disallow /media/sebwite/productdownloads/*.pdf$
Disallow /checkout/*
Disallow /alltag-edc/*.html$
Disallow /taktische-sicherheit-selbstverteidigung/*
Disallow /akkus/*
Disallow /sale-product/*
Disallow /olight-flash-sale/*.html
Disallow /flash-sale/*
Disallow /alle-taschenlampen/*
Disallow /rest/*
Disallow /flash-sale-taschenlampe/*.html$
Disallow /flexibleforms/*
Disallow /christmas/*
Disallow /olight-acc-Serien/*
Disallow /detail.html*skuId%3D*

googlebot
googlebot

Rule Path
Allow .css
Allow .js
Allow .webp
Allow .jpg
Allow .png
Allow .jpeg

googlebot-image

Rule Path
Allow .webp
Allow .jpg
Allow .png
Allow .jpeg

dataforseobot

Rule Path
Disallow /

linkedinbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

com/bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

whatsapp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

wespe.de spider

Rule Path
Disallow /

cimri.com spider 1.x

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zumibot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

intersearch.de spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exabot-thumbnails

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

python

Rule Path
Disallow /

websnake

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

pesticides

Rule Path
Disallow /

toads

Rule Path
Disallow /

common salt

Rule Path
Disallow /

the french

Rule Path
Disallow /

recruitment agencies

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wpscan

Rule Path
Disallow /

httrack

Rule Path
Disallow /

antsword

Rule Path
Disallow /

harvest

Rule Path
Disallow /

audit

Rule Path
Disallow /

dirbuster

Rule Path
Disallow /

pangolin

Rule Path
Disallow /

nmap

Rule Path
Disallow /

sqln

Rule Path
Disallow /

hydra

Rule Path
Disallow /

parser

Rule Path
Disallow /

libwww

Rule Path
Disallow /

bbbike

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

w3af

Rule Path
Disallow /

nikto

Rule Path
Disallow /

owasp

Rule Path
Disallow /

fimap

Rule Path
Disallow /

havij

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

babykrokodil

Rule Path
Disallow /

netsparker

Rule Path
Disallow /

httperf

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.olightstore.de/sitemap.xml
sitemap https://m.olightstore.de/sitemap.xml

Comments

  • Robots.txt file for olightstore.de
  • If you are passionate about the outdoors and lifestyle, then please visit https://blog.obuy.com!
  • Sitemaps
  • Disallow
  • Noindex
  • Allow
  • Undefined spiders are forbidden
  • ______ __ __ ____
  • / ____/__ / /_ ____ __ __/ /_ ____ / __/
  • / / __/ _ \/ __/ / __ \/ / / / __/ / __ \/ /_
  • / /_/ / __/ /_ / /_/ / /_/ / /_ / /_/ / __/
  • \_____\___/\__/ \____/\__,_/\__/ \____/_/
  • / /_ ___ ________ __ ______ __ __
  • / __ \/ _ \/ ___/ _ \ / / / / __ \/ / / /
  • / / / / __/ / / __/ / /_/ / /_/ / /_/ /
  • /_/ /_/\___/_/ \___/ \__, /\____/\__,_/
  • _/____/____ __ _ __
  • ____ ___ ___ ____/ /___/ / (_)___ ____ _ / /__(_)___/ /____
  • / __ `__ \/ _ \/ __ / __ / / / __ \/ __ `/ / //_/ / __ / ___/
  • / / / / / / __/ /_/ / /_/ / / / / / / /_/ / / , / / /_/ (__ ) _ _
  • /_/ /_/ /_/\___/\__,_/\__,_/_/_/_/ /_/\__, / /_/|_/_/\__,_/____(_|_|_)
  • /____/
  • If you're here because you're a curious programmer, engineer, or SEO,

Warnings

  • 2 invalid lines.
  • `noindex` is not a known field.