L3Cube-MahaSum: A Comprehensive Dataset and BART Models for Abstractive Text Summarization in Marathi

Pranita Deshmukh, Nikita Kulkarni, Sanhita Kulkarni, Kareena Manghani, Raviraj Joshi
10/11/2024
cs.CLcs.LG

Official code: l3cube-pune/MarathiNLP (160 stars, last commit 2025-09-14).

Abstract

We present the MahaSUM dataset, a large-scale collection of diverse news articles in Marathi, designed to facilitate the training and evaluation of models for abstractive summarization tasks in Indic languages. The dataset, containing 25k samples, was created by scraping articles from a wide range of online news sources and manually verifying the abstract summaries. Additionally, we train an IndicBART model, a variant of the BART model tailored for Indic languages, using the MahaSUM dataset. We evaluate the performance of our trained models on the task of abstractive summarization and demonstrate their effectiveness in producing high-quality summaries in Marathi. Our work contributes to the advancement of natural language processing research in Indic languages and provides a valuable resource for future research in this area using state-of-the-art models. The dataset and models are shared publicly at https://github.com/l3cube-pune/MarathiNLP

View on arXivView PDF

Code Implementations(1)

l3cube-pune/MarathiNLPOfficial100%

Marathi NLP - is a repository dedicated to development of tools and resources for Marathi language.

16019Python, Jupyter NotebookJan 8, 20211 years ago
bertdatasetmachine-learningmarathimarathi-language+5 more

Similar Papers

L3Cube-MahaNews: News-based Short Text and Long Document Classification Datasets in Marathi

87% match1 repo1602024

Abstractive Summarization of Low resourced Nepali language using Multilingual Transformers

85% match2024

Bridging the Data Gap: Creating a Hindi Text Summarization Dataset from the English XSUM

84% match2026

MultiBanAbs: A Comprehensive Multi-Domain Bangla Abstractive Text Summarization Dataset

84% match2025

MahaParaphrase: A Marathi Paraphrase Detection Corpus and BERT-based Models

84% match1 repo1602025

Abstractive Text Summarization for Contemporary Sanskrit Prose: Issues and Challenges

84% match2025

Cite this paper

@article{deshmukh2024lcubemahasum,
  title  = {L3Cube-MahaSum: A Comprehensive Dataset and BART Models for Abstractive Text Summarization in Marathi},
  author = {Pranita Deshmukh and Nikita Kulkarni and Sanhita Kulkarni and Kareena Manghani and Raviraj Joshi},
  year   = {2024},
  eprint = {2410.09184},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2410.09184v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2410.09184.svg)](https://codeofpaper.com/paper/2410.09184)

Discussion