Log In Sign Up

olightstore.ca
robots.txt

Robots Exclusion Standard data for olightstore.ca

Resource Scan

Scan Details

Site Domain olightstore.ca
Base Domain olightstore.ca
Scan Status Ok
Last Scan2024-09-25T18:14:50+00:00
Next Scan 2024-10-25T18:14:50+00:00

Last Scan

Scanned2024-09-25T18:14:50+00:00
URL https://olightstore.ca/robots.txt
Domain IPs 13.35.238.109, 13.35.238.17, 13.35.238.41, 13.35.238.93
Response IP 13.35.238.109
Found Yes
Hash 510540f0bff4dccfb7e89d1c41eaf78957f68e54310e1347bc0a1fbe7ab9872a
SimHash e156d0d89d77

Groups

*

Rule Path
Disallow /review/product/
Disallow /?gclid*
Disallow /?olinkid*
Disallow /?ref*
Disallow /?wbraid
Disallow /user
Disallow /error
Disallow /pay
Disallow /cart
Disallow /register
Disallow /invalidation.html
Disallow /?_channel_track_key=*
Disallow /login.html
Disallow /_resolver
Disallow /member
Disallow /.html

dataforseobot

Rule Path
Disallow /

linkedinbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

com/bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

whatsapp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

wespe.de spider

Rule Path
Disallow /

cimri.com spider 1.x

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

zumibot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

intersearch.de spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exabot-thumbnails

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

python

Rule Path
Disallow /

websnake

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

pesticides

Rule Path
Disallow /

toads

Rule Path
Disallow /

common salt

Rule Path
Disallow /

the french

Rule Path
Disallow /

recruitment agencies

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wpscan

Rule Path
Disallow /

httrack

Rule Path
Disallow /

antsword

Rule Path
Disallow /

harvest

Rule Path
Disallow /

audit

Rule Path
Disallow /

dirbuster

Rule Path
Disallow /

pangolin

Rule Path
Disallow /

nmap

Rule Path
Disallow /

sqln

Rule Path
Disallow /

hydra

Rule Path
Disallow /

parser

Rule Path
Disallow /

libwww

Rule Path
Disallow /

bbbike

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

w3af

Rule Path
Disallow /

nikto

Rule Path
Disallow /

owasp

Rule Path
Disallow /

fimap

Rule Path
Disallow /

havij

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

babykrokodil

Rule Path
Disallow /

netsparker

Rule Path
Disallow /

httperf

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://m.olightstore.ca/sitemap.xml
sitemap https://www.olightstore.ca/sitemap.xml
Back to top

Comments

  • Sitemaps
  • Undefined spiders are forbidden
  • ______ __ __ ____
  • / ____/__ / /_ ____ __ __/ /_ ____ / __/
  • / / __/ _ \/ __/ / __ \/ / / / __/ / __ \/ /_
  • / /_/ / __/ /_ / /_/ / /_/ / /_ / /_/ / __/
  • \_____\___/\__/ \____/\__,_/\__/ \____/_/
  • / /_ ___ ________ __ ______ __ __
  • / __ \/ _ \/ ___/ _ \ / / / / __ \/ / / /
  • / / / / __/ / / __/ / /_/ / /_/ / /_/ /
  • /_/ /_/\___/_/ \___/ \__, /\____/\__,_/
  • _/____/____ __ _ __
  • ____ ___ ___ ____/ /___/ / (_)___ ____ _ / /__(_)___/ /____
  • / __ `__ \/ _ \/ __ / __ / / / __ \/ __ `/ / //_/ / __ / ___/
  • / / / / / / __/ /_/ / /_/ / / / / / / /_/ / / , / / /_/ (__ ) _ _
  • /_/ /_/ /_/\___/\__,_/\__,_/_/_/_/ /_/\__, / /_/|_/_/\__,_/____(_|_|_)
  • /____/
  • If you're here because you're a curious programmer, engineer, or SEO,
Back to top

Warnings

  • 2 invalid lines.
Back to top