tiingo news - support@tiingo.com
*
| Rule |
Path |
| Disallow |
/bwapps/syndication/ |
| Disallow |
/wps/ |
| Disallow |
/misc/ |
| Disallow |
/wpvi/ |
| Disallow |
/help/ |
| Disallow |
/flash/ |
| Disallow |
/xml/ |
| Disallow |
/rss/ |
| Disallow |
/rss.php |
| Disallow |
/rss2/ |
| Disallow |
/schema/ |
| Disallow |
/msarss/ |
| Disallow |
/atom10/ |
| Disallow |
/js/ |
| Disallow |
/portal_redirects/ |
| Disallow |
/webbox/ |
| Disallow |
/snr_email/ |
| Disallow |
/xsl/ |
| Disallow |
/images/ |
| Disallow |
/gadgets/ |
| Disallow |
/cgi-bin/ |
| Disallow |
/ct/ |
| Disallow |
/cdn-error-page/ |
| Disallow |
/portal/site/home/template.NDM/ |
| Disallow |
/portal/site/home/template.PAGE/menuitem.e23d7f2be635f4725e0fa455c6908a0c/ |
| Disallow |
/portal/site/home/template.PAGE/menuitem.29c1c414dc41464723632d10e6908a0c/ |
| Disallow |
/portal/site/home/template.PAGE/menuitem.8529ea2ad8631dcd3bb97904c6908a0c/ |
| Disallow |
/portal/site/home/template.PAGE/menuitem.ddfc3807cdd1e0ce315528c6e6908a0c/ |
| Disallow |
/portal/site/home/template.PAGE/menuitem.* |
| Disallow |
/portal/site/home/global/ |
| Disallow |
/portal/site/home/template.PAGE/global/ |
| Disallow |
/portal/site/home/rss/ |
| Disallow |
/portal/site/home/template.PAGE/news/ |
| Disallow |
/portal/site/home/news/sections/ |
| Disallow |
/portal/site/home/news/all/ |
| Disallow |
/portal/site/home/template.PAGE/news/all/ |
| Disallow |
/portal/site/home/template.PAGE/news/company/ |
| Disallow |
/portal/site/home/news/multimedia/ |
| Disallow |
/portal/site/home/news/industries/ |
| Disallow |
/portal/site/home/news/industry/ |
| Disallow |
/portal/site/home/news/subjects/ |
| Disallow |
/portal/site/home/news/subject/ |
| Disallow |
/portal/site/home/news/languages/ |
| Disallow |
/portal/site/home/news/language/ |
| Disallow |
/portal/site/home/template.PAGE/permalink/ |
| Disallow |
/portal/site/home/template.NDM/permalink/ |
| Disallow |
/portal/site/home/welcome/ |
| Disallow |
/portal/site/home/template.PAGE/welcome/ |
| Disallow |
/portal/site/home/membership/ |
| Disallow |
/portal/site/home/media/services/ |
| Disallow |
/portal/site/home/my-business-wire/ |
| Disallow |
/portal/site/home/news/more/ |
| Disallow |
/portal/site/home/email/alert/ |
| Disallow |
/portal/site/home/template.NDM/email/alert/ |
| Disallow |
/portal/site/home/email/alerts/ |
| Disallow |
/portal/site/home/template.NDM/email/alerts/ |
| Disallow |
/portal/site/home/template.NDM/email/ |
| Disallow |
/portal/site/home/template.MAXIMIZE/tradeshows/ |
| Disallow |
/portal/site/home/services/overview/ |
| Disallow |
/portal/site/home/pr/press-release-distribution/ |
| Disallow |
/portal/site/home/ir/services/ |
| Disallow |
/portal/site/home/ir/press-release-distribution/ |
| Disallow |
/portal/site/home/regulatory-filings/ |
| Disallow |
/portal/site/home/xbrl/ |
| Disallow |
/portal/site/home/ir/hosting/ |
| Disallow |
/portal/site/home/ir/tools/ |
| Disallow |
/portal/site/home/distribution/americas/ |
| Disallow |
/portal/site/home/distribution/global/ |
| Disallow |
/portal/site/home/resources/ |
| Disallow |
/portal/site/home/news-online/all/ |
| Disallow |
/portal/site/home/about/overview/ |
| Disallow |
/portal/site/home/business-wire/ |
| Disallow |
/portal/site/home/about/2008/ |
| Disallow |
/portal/site/home/bureaus/world/ |
| Disallow |
/portal/site/eon/search/ |
| Disallow |
/portal/site/eon/home/ |
| Disallow |
/portal/site/eon/template.PAGE/home/ |
| Disallow |
/portal/site/eon/template.PAGE/news/ |
| Disallow |
/portal/site/eon/template.PAGE/permalink/ |
| Disallow |
/portal/site/eon/news/search/ |
| Disallow |
/portal/site/eon/news/industry/ |
| Disallow |
/portal/site/eon/news/subject/ |
| Disallow |
/portal/site/eon/news/geography/ |
| Disallow |
/portal/site/google/ |
rhwsspider
| Rule |
Path |
| Allow |
/portal/site/rohmhaas/ |
| Disallow |
/portal/site/home/ |
rhswdspider
| Rule |
Path |
| Allow |
/portal/site/rohmhaas/ |
| Disallow |
/portal/site/home/ |
mmm-google-two
| Rule |
Path |
| Allow |
/portal/site/3m/ |
mmm-google-four
| Rule |
Path |
| Allow |
/portal/site/3m/ |
coveoenterprisesearch
| Rule |
Path |
| Allow |
/portal/site/transcore/ |
mob2bw
| Rule |
Path |
| Allow |
/portal/site/exxonmobil/ |
| Allow |
/portal/site/exxonmobilchemical/ |
scoutjet
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yahoo! slurp
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
bingbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yandexbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
twitterbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot-image
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
ahrefsbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
spinn3r
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
omgilibot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
msnbot-newsblogs
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
addthis.com robot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yandexnews
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
livelapbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
msnbot-udiscovery
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
paperlibot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
trendictionbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
newslebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yandeximages
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
diffbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
tweetmemebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mail.ru_bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
rediffnewsbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
linkedinbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yandeximageresizer
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mj12bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
everyonesocialbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
hubspot page fetching bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
konqueror
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
msnbot-media
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
zumbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
businesswirebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
picturebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
interfaxbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
interfaxscanbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
kraken
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
flamingo_searchengine
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
linkdexbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
nachtschatten, neofonie search:robot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
vocusbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
umbot-ln
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yeti
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
umbot-fc
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
openhosebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot-mobile
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
wikioimagesbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
scooperbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
kemvibot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
xintellibot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
archive.org_bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
semrushbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
showyoubot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
bitlybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
veooz
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
zitebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
tineye-bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
exabot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
tweetedtimes bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
rogerbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
james bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
newsbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
blekkobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
contextad bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
queryseekerspider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
squirrobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
marketbrewbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mixbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
abot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
ms search 6.0 robot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
heritrix
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
dotbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
dow jones searchbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mediajam-bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
slackbot-linkexpanding
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
landau-media-spider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
surveybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
socialshare
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
ldrbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
wasalive-bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
gozaikbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
marketwirebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
seznambot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
g2reader-bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
gyffu_bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
academicbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
bufferbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
ftrf: friendly robot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yolinkbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
rightintelbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
claritybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
cxensebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yandex.gazeta bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
newslookup-bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
sreleasebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
nerdybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
skimbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
datagnionbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
archiveteam archivebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
focuseekbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
slurp
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
linkpadbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mojeekbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yioopbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
sinaweibobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
spiderbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
swayy api
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
iisbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
msnbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
robot leapit.com
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
gsa-crawler
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
vegebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
apis-google
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mediapartners-google
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
adsbot-google-mobile
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
adsbot-google
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot-news
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
googlebot-video
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
duckduckbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider-image
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider-video
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider-news
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider-favo
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider-cpro
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider-ads
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
baiduspider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
omgilibot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
facebot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
applenewsbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
expo9
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
nuzzel
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
newspaper
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
Comments