Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer

Adar Kahana, Jaya Susan Mathew, Said Bleik, Jeremy Reynolds, Oren Elisha
2/1/2024
cs.CLcs.AI

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

With the widespread adoption of Large Language Models (LLMs), in this paper we investigate the multilingual capability of these models. Our preliminary results show that, translating the native language context, question and answer into a high resource language produced the best results.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers

88% match2024

Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ

88% match1 repo52024

A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers

88% match1 repo252024

MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation

87% match2025

Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impact

87% match2024

Multilingual Large Language Models: A Systematic Survey

87% match1 repo352024

Cite this paper

@article{kahana2024evaluation,
  title  = {Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer},
  author = {Adar Kahana and Jaya Susan Mathew and Said Bleik and Jeremy Reynolds and Oren Elisha},
  year   = {2024},
  eprint = {2402.01065},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2402.01065v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2402.01065.svg)](https://codeofpaper.com/paper/2402.01065)

Discussion