Introducing DictaLM -- A Large Generative Language Model for Modern Hebrew

Shaltiel Shmidman, Avi Shmidman, Amir David Nissan Cohen, Moshe Koppel
9/25/2023
cs.CL

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

We present DictaLM, a large-scale language model tailored for Modern Hebrew. Boasting 7B parameters, this model is predominantly trained on Hebrew-centric data. As a commitment to promoting research and development in the Hebrew language, we release both the foundation model and the instruct-tuned model under a Creative Commons license. Concurrently, we introduce DictaLM-Rab, another foundation model geared towards Rabbinic/Historical Hebrew. These foundation models serve as ideal starting points for fine-tuning various Hebrew-specific tasks, such as instruction, Q&A, sentiment analysis, and more. This release represents a preliminary step, offering an initial Hebrew LLM model for the Hebrew NLP community to experiment with.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Danish Foundation Models

89% match2023

RakutenAI-7B: Extending Large Language Models for Japanese

88% match2024

DaG LLM ver 1.0: Pioneering Instruction-Tuned Language Modeling for Korean NLP

88% match2023

PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models

88% match2023

TigerBot: An Open Multilingual Multitask LLM

87% match1 repo2.3k2023

Panda LLM: Training Data and Evaluation for Open-Sourced Chinese Instruction-Following Large Language Models

87% match1 repo1.0k2023

Cite this paper

@article{shmidman2023introducing,
  title  = {Introducing DictaLM -- A Large Generative Language Model for Modern Hebrew},
  author = {Shaltiel Shmidman and Avi Shmidman and Amir David Nissan Cohen and Moshe Koppel},
  year   = {2023},
  eprint = {2309.14568},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2309.14568v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2309.14568.svg)](https://codeofpaper.com/paper/2309.14568)

Discussion