Log In Sign Up

brillianteers.com
robots.txt

Robots Exclusion Standard data for brillianteers.com

Resource Scan

Scan Details

Site Domain brillianteers.com
Base Domain brillianteers.com
Scan Status Ok
Last Scan2025-12-29T10:38:31+00:00
Next Scan 2026-01-28T10:38:31+00:00

Last Scan

Scanned2025-12-29T10:38:31+00:00
URL https://brillianteers.com/robots.txt
Redirect https://www.brillianteers.com/robots.txt
Redirect Domain www.brillianteers.com
Redirect Base brillianteers.com
Domain IPs 192.124.249.39
Redirect IPs 192.124.249.39
Response IP 192.124.249.39
Found Yes
Hash e59f4bfa3808fa78711f75ba08dfef32e915475da02c91d600de781506b1b522
SimHash 7b06fd42cf09

Groups

*

Rule Path
Disallow /index.php/
Disallow /*?*
Disallow /*?srsltid=*
Disallow /*?cat=*
Disallow /*?diamond_ctr_weight_vtr=*
Disallow /*?_q=*
Disallow /*?q=*
Disallow /*?sections=*
Disallow /*?Click=*
Disallow /*?ring_color=*
Disallow /*?main_stone_type=*
Disallow /*?diamond_shape=*
Disallow /*?jewel_style=*
Disallow /*?price=*
Disallow /checkout/
Disallow */checkout/cart/*
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /catalogsearch/
Disallow /customer/
Disallow /customer/section/load/*
Disallow /customer/account/
Disallow /wishlist/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow */referer/*
Disallow */pub/static/*
Disallow */static/*
Disallow */media/catalog/*
Disallow */media/porto/*

Other Records

Field Value
crawl-delay 30

rogerbot

Rule Path
Disallow /

duckduckbot/1.1

Rule Path
Disallow /

dataforseobot/1.0

Rule Path
Disallow /

aasa-bot

Rule Path
Disallow /

mojeekbot/0.11

Rule Path
Disallow /

perplexitybot/1.0

Rule Path
Disallow /

seznambot/4.0

Rule Path
Disallow /

chatgpt-user/1.0

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

facebookexternalhit/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

meta-externalads/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

googlebot/2.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

googlebot-image

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

adsbot-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

adsbot-google-mobile

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingbot/2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top

Warnings

  • 2 invalid lines.
Back to top