finrange.com
robots.txt

Robots Exclusion Standard data for finrange.com

Resource Scan

Scan Details

Site Domain finrange.com
Base Domain finrange.com
Scan Status Ok
Last Scan2025-08-30T07:42:10+00:00
Next Scan 2025-09-29T07:42:10+00:00

Last Scan

Scanned2025-08-30T07:42:10+00:00
URL https://finrange.com/robots.txt
Domain IPs 213.139.211.140
Response IP 213.139.211.140
Found Yes
Hash ff81b89bd21c545eae80b8b5e5824cf576d51a561cbdc048549bfe5a4fabb979
SimHash 30ac616049b4

Groups

*

Rule Path
Allow /*.js$
Allow /*.css$
Allow /images/
Disallow /*/tag
Disallow /*/parsed-news
Disallow /parsed-news/
Disallow /*/disclosure
Disallow /*/feed
Disallow /*/error-404
Disallow /*/user/favorites
Disallow /*/user/profile
Disallow /*/pages/responsibility
Disallow /*/pages/confidence
Disallow /*/pages/cookie
Disallow /*/faq
Disallow /*/login/google
Disallow /*/login/yandex
Disallow /*/login/vkontakte
Disallow /*/login/mailru
Disallow /*/administrator-pannel
Disallow /*/index.php
Disallow /index.php
Disallow /index.php/
Disallow /*?session_id=
Disallow /*?utm_source=
Disallow /*?utm_medium=
Disallow /*?utm_campaign=
Disallow /*?type=
Disallow /*?sort=
Disallow /*?page=
Disallow /*?search=

ahrefsbot
semrushbot
mj12bot
dotbot
blexbot
magpierss
bubing
proximic
sogou
yodaobot
rogerbot
easouspider
jikespider
moget
ichiro
ezooms
linkedinbot
q2abot
maxpointcrawler
sosospider
yyspider
spinn3r
crystalsemanticsbot
genieo
hyipcommander
piplbot
biggerbetter
paperlibot
acoonbot
woobot
coralwebprx
grapeshotcrawler
experbot
turnitinbot
a6-indexer
unisterbot
seokicks-robot
urlappendbot
netseer
zumbot
ccbot
voltron
betabot
ia_archiver
seekportbot
imagesiftbot
dataforseobot
gptbot

Rule Path
Disallow /

googlebot
bingbot
yandexbot
applebot
duckduckbot
swiftbot
slurp
naverbot
yeti
exabot
seznambot
baiduspider
coccocbot
daumoa
mojeekbot
petalbot
stackrambler
mail.ru_bot
qwantify
aolbot
skynet
zapmetabot
kagibot
neevabot
bravebot
oai-searchbot
chatgpt-user
perplexitybot

Rule Path
Allow /
Disallow /ae/
Disallow /analitika/
Disallow /archive/
Disallow /at/
Disallow /au/
Disallow /br/
Disallow /ca/
Disallow /ch/
Disallow /co-in/
Disallow /competitions/
Disallow /data/
Disallow /dictionary%C3%90%C2%B8/
Disallow /disclosure/
Disallow /donations/
Disallow /feed/
Disallow /gb/
Disallow /ignite/
Disallow /in/
Disallow /industry/
Disallow /jp/
Disallow /kr/
Disallow /mkt_cap/
Disallow /mx/
Disallow /my/
Disallow /newsletters/
Disallow /nz/
Disallow /other/
Disallow /pages/
Disallow /parsed-news/
Disallow /portfolio/
Disallow /se/
Disallow /sector/
Disallow /topics-list/
Disallow /vn/
Disallow /ytd_performance/

Other Records

Field Value
sitemap https://finrange.com/sitemap.xml

Comments

  • Allow for all bots
  • Block unwanted paths for all bots
  • Blocking dynamic parameters
  • Blocking unwanted robots
  • Permission for search engines
  • Block fake or non-locale prefixes

Warnings

  • 2 invalid lines.