Sparse Regression for Machine Translation

Ergun Biçici
6/27/2024
cs.CLcs.AI

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

We use transductive regression techniques to learn mappings between source and target features of given parallel corpora and use these mappings to generate machine translation outputs. We show the effectiveness of $L_1$ regularized regression (\textit{lasso}) to learn the mappings between sparsely observed feature sets versus $L_2$ regularized regression. Proper selection of training instances plays an important role to learn correct feature mappings within limited computational resources and at expected accuracy levels. We introduce \textit{dice} instance selection method for proper selection of training instances, which plays an important role to learn correct feature mappings for improving the source and target coverage of the training set. We show that $L_1$ regularized regression performs better than $L_2$ regularized regression both in regression measurements and in the translation experiments using graph decoding. We present encouraging results when translating from German to English and Spanish to English. We also demonstrate results when the phrase table of a phrase-based decoder is replaced with the mappings we find with the regression model.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Learning Translation Quality Evaluation on Low Resource Languages from Large Language Models

82% match2023

Transfer Learning in $\ell_1$ Regularized Regression: Hyperparameter Selection Strategy based on Sharp Asymptotic Analysis

82% match2024

Semi-supervised Neural Machine Translation with Consistency Regularization for Low-Resource Languages

82% match2023

Predicting Machine Translation Performance on Low-Resource Languages: The Role of Domain Similarity

81% match2024

POMP: Probability-driven Meta-graph Prompter for LLMs in Low-resource Unsupervised Neural Machine Translation

80% match2024

Optimal Multi-Task Learning at Regularization Horizon for Speech Translation Task

80% match2025

Cite this paper

@article{biici2024sparse,
  title  = {Sparse Regression for Machine Translation},
  author = {Ergun Biçici},
  year   = {2024},
  eprint = {2406.19478},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.19478v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.19478.svg)](https://codeofpaper.com/paper/2406.19478)

Discussion