Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings

Gili Goldin, Shuly Wintner
7/30/2024
cs.CL

No confident code implementation found for this paper.

Abstract

We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is based on the DictaBERT architecture and demonstrates significant improvements in understanding parliamentary language according to the MLM task. We provide a detailed evaluation of the model's performance, showing improvements in perplexity and accuracy over the baseline DictaBERT model.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

The Knesset Corpus: An Annotated Corpus of Hebrew Parliamentary Proceedings

83% match2024

Dicta-LM 3.0: Advancing The Frontier of Hebrew Sovereign LLMs

82% match2026

Adapting LLMs to Hebrew: Unveiling DictaLM 2.0 with Enhanced Vocabulary and Instruction Capabilities

82% match2024

NeoDictaBERT: Pushing the Frontier of BERT models for Hebrew

80% match2025

IsraParlTweet: The Israeli Parliamentary and Twitter Resource

79% match1 repo22024

HalleluBERT: Let every token that has meaning bear its weight

78% match2025

Cite this paper

@article{goldin2024knessetdictabert,
  title  = {Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings},
  author = {Gili Goldin and Shuly Wintner},
  year   = {2024},
  eprint = {2407.20581},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.20581v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.20581.svg)](https://codeofpaper.com/paper/2407.20581)

Discussion