Log In Sign Up

bloomberg.co.jp
robots.txt

Robots Exclusion Standard data for bloomberg.co.jp

Resource Scan

Scan Details

Site Domain bloomberg.co.jp
Base Domain bloomberg.co.jp
Scan Status Ok
Last Scan2026-01-28T01:03:57+00:00
Next Scan 2026-02-04T01:03:57+00:00

Last Scan

Scanned2026-01-28T01:03:57+00:00
URL https://bloomberg.co.jp/robots.txt
Redirect https://www.bloomberg.co.jp/robots.txt
Redirect Domain www.bloomberg.co.jp
Redirect Base bloomberg.co.jp
Domain IPs 15.197.146.156, 3.33.146.110
Redirect IPs 23.210.99.2
Response IP 23.210.99.2
Found Yes
Hash 516d10d8dad75d197a21b55662dce16f18bc89e91b92900d5934e69639e965bc
SimHash b5115911f7f0

Groups

*

Rule Path
Disallow /offlinemessage/
Disallow /search
Disallow /company/search/
Disallow /professional/search/
Disallow /impact/search/
Disallow /ux/search/
Disallow /wnwi/search/
Disallow /gei/search/
Disallow /impact/search/
Disallow /netzeropathfinders/search/
Disallow /notices/search/
Disallow /distribution/search/
Disallow /ukinnovators/search/
Disallow /latam/search/
Disallow /faq/search/
Disallow /tc/search/
Disallow /sessions-publisher/
Disallow /sessions/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-http-client

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

google-apps

Rule Path
Disallow /

google-apps-script

Rule Path
Disallow /

appengine-google

Rule Path
Disallow /

google-cloud

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

feedly

Rule Path
Disallow /

feedlybot

Rule Path
Disallow /

feedlyapp

Rule Path
Disallow /

mwfeedparser

Rule Path
Disallow /

comscore

Rule Path
Disallow /

comscore

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

criteo

Rule Path
Disallow /

criteo-bot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

ntent

Rule Path
Disallow /

anderspinkbot

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

toutiaospider

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /
Allow /professional
Allow /company
Allow /latam

prtg

Rule Path
Disallow /

freshpingbot

Rule Path
Disallow /

panopta

Rule Path
Disallow /

datadogsynthetics

Rule Path
Disallow /

rackspace

Rule Path
Disallow /

censys

Rule Path
Disallow /

burp

Rule Path
Disallow /

burp

Rule Path
Disallow /

check_http

Rule Path
Disallow /

dotcommonitor

Rule Path
Disallow /

watchsumo

Rule Path
Disallow /

wormlybot

Rule Path
Disallow /

calibrebot

Rule Path
Disallow /

audistobot

Rule Path
Disallow /

hatena

Rule Path
Disallow /

hatena-bookmark

Rule Path
Disallow /

everyonesocialbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

netvibes

Rule Path
Disallow /

webceo

Rule Path
Disallow /

postano

Rule Path
Disallow /

rebelmouse

Rule Path
Disallow /

muck-rack

Rule Path
Disallow /

instapaperviewer

Rule Path
Disallow /

twurly

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

datagnionbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

discourse

Rule Path
Disallow /

medusa

Rule Path
Disallow /

pingback

Rule Path
Disallow /

wordpress

Rule Path
Disallow /

wp_ping

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

wesee

Rule Path
Disallow /

halebot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

unityplayer

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.bloomberg.co.jp/feeds/cojp/sitemap_index.xml
sitemap https://www.bloomberg.co.jp/feeds/cojp/sitemap_securities_index.xml
Back to top

Comments

  • Development Tools
  • AI/LLM Bots
  • Google Services
  • Major Company Bots
  • Feed & Content Aggregators
  • Analytics & Marketing
  • Search Engine Bots
  • Monitoring & Security
  • Social & Content
  • Potentially Malicious
  • Gaming/3D
Back to top

Warnings

  • 2 invalid lines.
Back to top