fintel.io
robots.txt

Robots Exclusion Standard data for fintel.io

Resource Scan

Scan Details

Site Domain fintel.io
Base Domain fintel.io
Scan Status Ok
Last Scan2024-11-12T04:16:18+00:00
Next Scan 2024-11-19T04:16:18+00:00

Last Scan

Scanned2024-11-12T04:16:18+00:00
URL https://fintel.io/robots.txt
Domain IPs 172.66.41.12, 172.66.42.244, 2606:4700:3108::ac42:290c, 2606:4700:3108::ac42:2af4
Response IP 172.66.41.12
Found Yes
Hash 382ec8290414a5bfa1da8327b8db7f89a166f9916fb53c3500c6a22329930f47
SimHash 494052ed2532

Groups

*

Rule Path
Disallow /auth/
Disallow /alert/
Disallow /alertStrategy/*
Disallow /authRedirect
Disallow /excel/
Disallow /upvote
Disallow /downvote
Disallow /screenerWS/
Disallow /follow/
Disallow /screenCreate/
Disallow /screenTrades/
Disallow /sot/
Disallow /sq/
Disallow /sit/
Disallow /api/

googlebot
bingbot
applebot
duckduckbot
slurp

Rule Path
Disallow /activists
Disallow /gammaPockets
Disallow /auth/
Disallow /alert/
Disallow /alertStrategy/*
Disallow /authRedirect
Disallow /daily
Disallow /xdata/
Disallow /excel/
Disallow /upvote
Disallow /downvote
Disallow /screenerWS/
Disallow /follow/
Disallow /screenCreate/
Disallow /screenTrades/
Disallow /chart/
Disallow /*/chart/
Disallow /ip/
Disallow /cp/
Disallow /*/cp/
Disallow /sonv/
Disallow /sit/
Disallow /*/sit/
Disallow /sgex/
Disallow /sscr/
Disallow /*/sscr/
Disallow /screen/
Disallow /*/screen/
Disallow /api/
Disallow /sftd/
Disallow /sof/
Disallow /sfca/
Disallow /*/sfca/
Disallow /sro
Disallow /sps/
Disallow /*/sps/
Disallow /fg/
Disallow /*/fg/

ccbot
omgilibot
omgili
facebookbot
scrapy
turnitin
megaindex.ru
uptimebot
rogerbot
ccbot
mauibot
cliqzbot
grammarly
ltx71 - (http://ltx71.com/)
yak
jaunt
mail.ru_bot
awariorssbot
awariosmartbot
yacybot
sitesucker
meta-externalagent
facebookexternalhit

Rule Path
Disallow /
Allow /robots.txt

mediapartners-google
ahrefsbot
ahrefssiteaudit

Rule Path
Allow /

baiduspider
yisouspider

Rule Path
Disallow /
Allow /robots.txt
Allow /sitemap*
Allow /investormap*
Allow /zh-hans
Allow /zh-hans/
Allow /zh-hans/s/cn/*
Allow /zh-hans/sfo/cn/*
Allow /zh-hans/so/cn/*
Allow /zh-hans/s/hk/*
Allow /zh-hans/sfo/hk/*
Allow /zh-hans/so/hk/*
Disallow /zh-hans/so/*/*/*
Disallow /zh-hans/sst/
Disallow /zh-hans/sob/
Disallow /zh-hans/sos/
Disallow /zh-hans/soe/
Disallow /zh-hans/somf/
Disallow /zh-hans/doc/

yandexbot
yandexmobilebot

Rule Path
Allow /robots.txt
Allow /sitemap*
Allow /investormap*
Allow /ru
Allow /ru/
Allow /ru/s/ru/*
Allow /ru/sfo/ru/*
Allow /ru/so/ru/*
Disallow /fg/
Disallow /follow/
Disallow /i/
Disallow /*/i/
Disallow /n/
Disallow /*/n/
Disallow /doc/
Disallow /*/doc/
Disallow /ru/so/*/*/*
Disallow /ru/sst/
Disallow /ru/sob/
Disallow /ru/sos/
Disallow /ru/soe/
Disallow /ru/somf/
Disallow /ru/doc/
Disallow /ar/
Disallow /bn/
Disallow /cs/
Disallow /da/
Disallow /de/
Disallow /el/
Disallow /es/
Disallow /es-mx/
Disallow /fi/
Disallow /fr/
Disallow /hi/
Disallow /hu/
Disallow /id/
Disallow /ko/
Disallow /ja/
Disallow /ms/
Disallow /no/
Disallow /pl/
Disallow /ro/
Disallow /ru/
Disallow /sv/
Disallow /th/
Disallow /vi/
Disallow /zh-hans/
Disallow /zh-hant/

seznambot

Rule Path
Allow /robots.txt
Allow /sitemap*
Allow /investormap*
Allow /cs
Allow /cs/
Allow /cs/s/cz/*
Allow /cs/sfo/cz/*
Allow /cs/so/cz/*
Disallow /fg/
Disallow /follow/
Disallow /i/
Disallow /*/i/
Disallow /n/
Disallow /*/n/
Disallow /rank/
Disallow /doc/
Disallow /*/doc/
Disallow /cs/so/*/*/*
Disallow /cs/sst/
Disallow /cs/sob/
Disallow /cs/sos/
Disallow /cs/soe/
Disallow /cs/somf/
Disallow /cs/doc/
Disallow /ar/
Disallow /bn/
Disallow /da/
Disallow /de/
Disallow /el/
Disallow /es/
Disallow /es-mx/
Disallow /fi/
Disallow /fr/
Disallow /hi/
Disallow /hu/
Disallow /id/
Disallow /kr/
Disallow /ja/
Disallow /ms/
Disallow /nl/
Disallow /no/
Disallow /pl/
Disallow /ro/
Disallow /ru/
Disallow /sv/
Disallow /th/
Disallow /tr/
Disallow /vi/
Disallow /zh-hans/
Disallow /zh-hant/

yeti

Rule Path
Disallow /
Allow /robots.txt
Allow /sitemap*
Allow /investormap*
Allow /ko
Allow /ko/
Allow /ko/s/kr/*
Allow /ko/sfo/kr/*
Allow /ko/so/kr/*
Disallow /ko/so/*/*/*
Disallow /ko/sst/
Disallow /ko/sob/
Disallow /ko/sos/
Disallow /ko/soe/
Disallow /ko/somf/
Disallow /ko/doc/

Other Records

Field Value
sitemap https://fintel.io/sitemap.xml
sitemap https://fintel.io/investormap.xml
sitemap https://fintel.io/sitemapshorts.xml
sitemap https://fintel.io/sitemapOptions.xml
sitemap https://fintel.io/sitemapsn.xml
sitemap https://fintel.io/sitemapForex.xml
sitemap https://fintel.io/sitemapNews.xml
sitemap https://fintel.io/sitemapco/tt
sitemap https://fintel.io/sitemapco/de
sitemap https://fintel.io/sitemapco/tw
sitemap https://fintel.io/sitemapco/hk
sitemap https://fintel.io/sitemapco/ps
sitemap https://fintel.io/sitemapco/pt
sitemap https://fintel.io/sitemapco/tz
sitemap https://fintel.io/sitemapco/dk
sitemap https://fintel.io/sitemapco/lt
sitemap https://fintel.io/sitemapco/lu
sitemap https://fintel.io/sitemapco/lv
sitemap https://fintel.io/sitemapco/hr
sitemap https://fintel.io/sitemapco/ua
sitemap https://fintel.io/sitemapco/hu
sitemap https://fintel.io/sitemapco/qa
sitemap https://fintel.io/sitemapco/ug
sitemap https://fintel.io/sitemapco/ma
sitemap https://fintel.io/sitemapco/uk
sitemap https://fintel.io/sitemapco/id
sitemap https://fintel.io/sitemapco/ie
sitemap https://fintel.io/sitemapco/us
sitemap https://fintel.io/sitemapco/ec
sitemap https://fintel.io/sitemapco/ee
sitemap https://fintel.io/sitemapco/eg
sitemap https://fintel.io/sitemapco/il
sitemap https://fintel.io/sitemapco/ae
sitemap https://fintel.io/sitemapco/in
sitemap https://fintel.io/sitemapco/za
sitemap https://fintel.io/sitemapco/mt
sitemap https://fintel.io/sitemapco/mu
sitemap https://fintel.io/sitemapco/is
sitemap https://fintel.io/sitemapco/mw
sitemap https://fintel.io/sitemapco/it
sitemap https://fintel.io/sitemapco/mx
sitemap https://fintel.io/sitemapco/my
sitemap https://fintel.io/sitemapco/es
sitemap https://fintel.io/sitemapco/ve
sitemap https://fintel.io/sitemapco/ar
sitemap https://fintel.io/sitemapco/at
sitemap https://fintel.io/sitemapco/zm
sitemap https://fintel.io/sitemapco/na
sitemap https://fintel.io/sitemapco/au
sitemap https://fintel.io/sitemapco/vn
sitemap https://fintel.io/sitemapco/ng
sitemap https://fintel.io/sitemapco/ro
sitemap https://fintel.io/sitemapco/zw
sitemap https://fintel.io/sitemapco/nl
sitemap https://fintel.io/sitemapco/no
sitemap https://fintel.io/sitemapco/rs
sitemap https://fintel.io/sitemapco/bd
sitemap https://fintel.io/sitemapco/ru
sitemap https://fintel.io/sitemapco/be
sitemap https://fintel.io/sitemapco/jm
sitemap https://fintel.io/sitemapco/fi
sitemap https://fintel.io/sitemapco/bg
sitemap https://fintel.io/sitemapco/jo
sitemap https://fintel.io/sitemapco/jp
sitemap https://fintel.io/sitemapco/bh
sitemap https://fintel.io/sitemapco/bm
sitemap https://fintel.io/sitemapco/fr
sitemap https://fintel.io/sitemapco/nz
sitemap https://fintel.io/sitemapco/sa
sitemap https://fintel.io/sitemapco/br
sitemap https://fintel.io/sitemapco/se
sitemap https://fintel.io/sitemapco/sg
sitemap https://fintel.io/sitemapco/bw
sitemap https://fintel.io/sitemapco/si
sitemap https://fintel.io/sitemapco/sk
sitemap https://fintel.io/sitemapco/ke
sitemap https://fintel.io/sitemapco/gb
sitemap https://fintel.io/sitemapco/ca
sitemap https://fintel.io/sitemapco/om
sitemap https://fintel.io/sitemapco/gh
sitemap https://fintel.io/sitemapco/ch
sitemap https://fintel.io/sitemapco/ci
sitemap https://fintel.io/sitemapco/kr
sitemap https://fintel.io/sitemapco/cl
sitemap https://fintel.io/sitemapco/cn
sitemap https://fintel.io/sitemapco/gr
sitemap https://fintel.io/sitemapco/co
sitemap https://fintel.io/sitemapco/kw
sitemap https://fintel.io/sitemapco/ky
sitemap https://fintel.io/sitemapco/kz
sitemap https://fintel.io/sitemapco/th
sitemap https://fintel.io/sitemapco/pe
sitemap https://fintel.io/sitemapco/cy
sitemap https://fintel.io/sitemapco/lb
sitemap https://fintel.io/sitemapco/cz
sitemap https://fintel.io/sitemapco/ph
sitemap https://fintel.io/sitemapco/tn
sitemap https://fintel.io/sitemapco/pk
sitemap https://fintel.io/sitemapco/pl
sitemap https://fintel.io/sitemapco/tr
sitemap https://fintel.io/sitemapco/lk

Comments

  • Disallow: /zh-hans/*
  • Disallow: /tr/ allow Turkish
  • Disallow: /
  • naver for Korea
  • Disallow: /ko/*