Log In Sign Up

vdata.nikkei.com
robots.txt

Robots Exclusion Standard data for vdata.nikkei.com

Resource Scan

Scan Details

Site Domain vdata.nikkei.com
Base Domain nikkei.com
Scan Status Ok
Last Scan2025-03-03T09:35:47+00:00
Next Scan 2025-04-02T09:35:47+00:00

Last Scan

Scanned2025-03-03T09:35:47+00:00
URL https://vdata.nikkei.com/robots.txt
Domain IPs 13.35.202.100, 13.35.202.23, 13.35.202.51, 13.35.202.87, 2600:9000:2078:200:18:5aca:7200:93a1, 2600:9000:2078:2600:18:5aca:7200:93a1, 2600:9000:2078:3400:18:5aca:7200:93a1, 2600:9000:2078:4600:18:5aca:7200:93a1, 2600:9000:2078:9e00:18:5aca:7200:93a1, 2600:9000:2078:c600:18:5aca:7200:93a1, 2600:9000:2078:d000:18:5aca:7200:93a1, 2600:9000:2078:e200:18:5aca:7200:93a1
Response IP 13.35.202.23
Found Yes
Hash d6a30ce97bbd4efdd4bb88dd2d6e3e2495ce4d16bce11f5e46974e698127308a
SimHash b8566a15c993

Groups

*

Rule Path
Disallow /tags/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://vdata.nikkei.com/sitemap.xml
Back to top

Comments

  • If you want to use our data in machine learning, please contact us from the following url.
  • ja: https://nkbb.nikkei.co.jp/alternative/article_data/
  • en: https://nkbb.nikkei.co.jp/en/dataset/nikkei-news-articles
  • If you are interested in working in our team, please visit below.
  • https://hack.nikkei.com/jobs/visual_journalism/
Back to top