RakutenAI-7B: Extending Large Language Models for Japanese

Rakuten Group, Aaron Levine, Connie Huang, Chenguang Wang, Eduardo Batista +25 more
3/21/2024
cs.CLcs.LG

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

We introduce RakutenAI-7B, a suite of Japanese-oriented large language models that achieve the best performance on the Japanese LM Harness benchmarks among the open 7B models. Along with the foundation model, we release instruction- and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat respectively, under the Apache 2.0 license.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Instruction-Tuning Open-Weight Language Models for BPMN Model Generation

87% match2025

Qianfan-VL: Domain-Enhanced Universal Vision-Language Models

85% match1 repo4252025

CodeShell Technical Report

85% match2024

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

84% match2026

InCoder-32B: Code Foundation Model for Industrial Scenarios

84% match1 repo12026

Kotlin ML Pack: Technical Report

84% match2024

Cite this paper

@article{group2024rakutenaib,
  title  = {RakutenAI-7B: Extending Large Language Models for Japanese},
  author = {Rakuten Group and Aaron Levine and Connie Huang and Chenguang Wang and Eduardo Batista and Ewa Szymanska and Hongyi Ding and Hou Wei Chou and Jean-François Pessiot and Johanes Effendi and Justin Chiu and Kai Torben Ohlhus and Karan Chopra and Keiji Shinzato and Koji Murakami and Lee Xiong and Lei Chen and Maki Kubota and Maksim Tkachenko and Miroku Lee and Naoki Takahashi and Prathyusha Jwalapuram and Ryutaro Tatsushima and Saurabh Jain and Sunil Kumar Yadav and Ting Cai and Wei-Te Chen and Yandi Xia and Yuki Nakayama and Yutaka Higashiyama},
  year   = {2024},
  eprint = {2403.15484},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.15484v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.15484.svg)](https://codeofpaper.com/paper/2403.15484)

Discussion