Log In Sign Up

grownbrilliance.com
robots.txt

Robots Exclusion Standard data for grownbrilliance.com

Resource Scan

Scan Details

Site Domain grownbrilliance.com
Base Domain grownbrilliance.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-03T17:32:14+00:00
Next Scan 2024-12-02T17:32:14+00:00

Last Successful Scan

Scanned2024-07-13T17:31:10+00:00
URL https://grownbrilliance.com/robots.txt
Redirect https://www.grownbrilliance.com/robots.txt
Redirect Domain www.grownbrilliance.com
Redirect Base grownbrilliance.com
Domain IPs 172.66.40.192, 172.66.43.64, 2606:4700:3108::ac42:28c0, 2606:4700:3108::ac42:2b40
Redirect IPs 172.66.40.192, 172.66.43.64, 2606:4700:3108::ac42:28c0, 2606:4700:3108::ac42:2b40
Response IP 172.66.43.64
Found Yes
Hash 7b0ae241d9da0a296de8669da5784fda577e37b7c4081c6bf6f5e4597b75bbf5
SimHash 5bd4d15ad474

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

googlebot

Rule Path
Disallow
Disallow /productimages/*/*/*-M2.png$

googlebot-image

Rule Path
Disallow
Disallow /productimages/*/*/*-M2.png$

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

archive.org_bot

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

aranhabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

gluten free crawler

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

lexxebot/1.0

Rule Path
Disallow /

obot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

symfony spider

Rule Path
Disallow /

obot

Rule Path
Disallow /

symfony spider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

lexxebot/1.0

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sitebot/0.1

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

netseer crawler

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sosospider+(+http://help.soso.com/webspider.htm)

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

discobot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm

Product Comment
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm 07)
Rule Path
Disallow /

sistrix

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

garlikcrawler/1.1 (http://garlik.com/, crawler@garlik.com)

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

bl.uk_lddc_bot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

bender

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

linguee

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

wesee:search

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

spbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

dot-bot

Rule Path
Disallow /

btt agent sfoaws

Rule Path
Disallow /

productadsbot

Rule Path
Disallow /

addthis

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

viralvideochart

Rule Path
Disallow /

apache-httpclient

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

gwpimages

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

tbot-nutch

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

typhoeus

Rule Path
Disallow /

ning

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

google-http-java-client

Rule Path
Disallow /

stores.pl

Rule Path
Disallow /

chimpfeedr.com

Rule Path
Disallow /

genieo

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

commoncrawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

kyoto-tohoku-crawler

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

y!j-asr

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

worldclient.dll

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

alexabot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

powermapper

Rule Path
Disallow .pdf*
Disallow .PDF*
Disallow /*?*
Disallow /document
Disallow /staging
Disallow /rebranding
Disallow /navy
Disallow /gb-panel
Disallow /cron_jobs
Disallow /login
Disallow /shoppingcart
Disallow /checkout
Disallow /diamond_search_result_ajax
Disallow /sucuri-backups
Disallow /blog/wp-admin
Disallow /boca-customer-contact
Disallow /hou-customer-contact
Disallow /kop-customer-contact
Disallow /nyc-customer-contact
Disallow /hj-event-sign-up-form
Back to top

Other Records

Field Value
sitemap https://www.grownbrilliance.com/sitemapindex.xml
sitemap https://www.grownbrilliance.com/sitemap_category_static_pages.xml
sitemap https://www.grownbrilliance.com/sitemap_product_pages_1.xml
sitemap https://www.grownbrilliance.com/sitemap_product_video_1.xml
Back to top