Nepali Video Captioning using CNN-RNN Architecture

Bipesh Subedi, Saugat Singh, Bal Krishna Bal
11/5/2023
cs.CVcs.CLcs.LG

No confident code implementation found for this paper.

Abstract

This article presents a study on Nepali video captioning using deep neural networks. Through the integration of pre-trained CNNs and RNNs, the research focuses on generating precise and contextually relevant captions for Nepali videos. The approach involves dataset collection, data preprocessing, model implementation, and evaluation. By enriching the MSVD dataset with Nepali captions via Google Translate, the study trains various CNN-RNN architectures. The research explores the effectiveness of CNNs (e.g., EfficientNetB0, ResNet101, VGG16) paired with different RNN decoders like LSTM, GRU, and BiLSTM. Evaluation involves BLEU and METEOR metrics, with the best model being EfficientNetB0 + BiLSTM with 1024 hidden dimensions, achieving a BLEU-4 score of 17 and METEOR score of 46. The article also outlines challenges and future directions for advancing Nepali video captioning, offering a crucial resource for further research in this area.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Automatic speech recognition for the Nepali language using CNN, bidirectional LSTM and ResNet

83% match1 repo262024

Using Deep Learning to Generate Semantically Correct Hindi Captions

83% match2026

Towards Nepali-language LLMs: Efficient GPT training with a Nepali BPE tokenizer

78% match2025

Development of Pre-Trained Transformer-based Models for the Nepali Language

78% match2024

Creating and Evaluating Code-Mixed Nepali-English and Telugu-English Datasets for Abusive Language Detection Using Traditional and Deep Learning Models

77% match2025

Learning Sign Language Representation using CNN LSTM, 3DCNN, CNN RNN LSTM and CCN TD

77% match2024

Cite this paper

@article{subedi2023nepali,
  title  = {Nepali Video Captioning using CNN-RNN Architecture},
  author = {Bipesh Subedi and Saugat Singh and Bal Krishna Bal},
  year   = {2023},
  eprint = {2311.02699},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.02699v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.02699.svg)](https://codeofpaper.com/paper/2311.02699)

Discussion