llm-japanese-dataset v0: Construction of Japanese Chat Dataset for Large Language Models [in Japanese]

Masanori HIRANO, Masahiro SUZUKI, Hiroki SAKAJI

[Preprint] May 24, 2023

Abstract

This study constructed a Japanese chat dataset for large language models. The dataset contains approximately 8.4 million records and includes various tasks in chat format, such as translation and knowledge tasks. To confirm the benefits of our constructed dataset, we tuned an existing large language model and confirmed its performance qualitatively. Those results revealed challenges in building large language models and language resources for them in Japanese.

Keywords

Large Language Model; Dataset; Japanese; Chat;

doi

10.51094/jxiv.383

bibtex

@preprint{Hirano2023-llm-ja,
  title={{llm-japanese-dataset v0: Construction of Japanese Chat Dataset for Large Language Models [in Japanese]}},
  author={Masanori HIRANO and Masahiro SUZUKI and Hiroki SAKAJI},
  doi={10.51094/jxiv.383},
  year={2023}
}