bloomberg.co.jp
robots.txt

Robots Exclusion Standard data for bloomberg.co.jp

Resource Scan

Scan Details

Site Domain bloomberg.co.jp
Base Domain bloomberg.co.jp
Scan Status Ok
Last Scan2025-03-26T19:20:08+00:00
Next Scan 2025-04-02T19:20:08+00:00

Last Scan

Scanned2025-03-26T19:20:08+00:00
URL https://bloomberg.co.jp/robots.txt
Redirect https://www.bloomberg.co.jp/robots.txt
Redirect Domain www.bloomberg.co.jp
Redirect Base bloomberg.co.jp
Domain IPs 15.197.146.156, 3.33.146.110
Redirect IPs 23.210.99.2
Response IP 23.210.99.2
Found Yes
Hash 1031345fb634ed11a4ae9ef4c55474d095f935eb12e7def0e1c0aea8a1355b17
SimHash 7111d911f653

Groups

*

Rule Path
Disallow /offlinemessage/
Disallow /search
Disallow /company/search/
Disallow /professional/search/
Disallow /impact/search/
Disallow /ux/search/
Disallow /wnwi/search/
Disallow /gei/search/
Disallow /impact/search/
Disallow /netzeropathfinders/search/
Disallow /notices/search/
Disallow /distribution/search/
Disallow /ukinnovators/search/
Disallow /latam/search/
Disallow /faq/search/
Disallow /tc/search/
Disallow /sessions-publisher/
Disallow /sessions/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-http-client

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

google-apps

Rule Path
Disallow /

google-apps-script

Rule Path
Disallow /

appengine-google

Rule Path
Disallow /

google-cloud

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bloomberg.co.jp/feeds/cojp/sitemap_index.xml
sitemap https://www.bloomberg.co.jp/feeds/cojp/sitemap_securities_index.xml

Comments

  • Development Tools
  • AI/LLM Bots
  • Google Services