Mastering the Craft of Data Synthesis for CodeLLMs

Meng Chen, Philip Arthur, Qianyu Feng, Cong Duy Vu Hoang, Yu-Heng Hong +11 more
10/16/2024
cs.SEcs.AI

No official code found. Best implementation: chenmengdx/awesome-data-synthesis-for-code-llm (8 stars, last commit 2024-11-24).

Abstract

Large language models (LLMs) have shown impressive performance in \emph{code} understanding and generation, making coding tasks a key focus for researchers due to their practical applications and value as a testbed for LLM evaluation. Data synthesis and filtering techniques have been widely adopted and shown to be highly effective in this context. In this paper, we present a focused survey and taxonomy of these techniques, emphasizing recent advancements. We highlight key challenges, explore future research directions, and offer practical guidance for new researchers entering the field.

View on arXivView PDF

Code Implementations(1)

chenmengdx/awesome-data-synthesis-for-code-llmCommunity100%

Repo for data synthesis and filtering techniques of Code LLMs, covering papers, datasets, benchmarks, and papers etc.

81Nov 23, 20241 years ago

Similar Papers

Examination of Code generated by Large Language Models

87% match2024

MultiAIGCD: A Comprehensive dataset for AI Generated Code Detection Covering Multiple Languages, Models,Prompts, and Scenarios

87% match2025

CodeSift: An LLM-Based Reference-Less Framework for Automatic Code Validation

86% match2024

Code LLMs: A Taxonomy-based Survey

86% match2024

Benchmarks and Metrics for Evaluations of Code Generation: A Critical Review

86% match2024

CatCode: A Comprehensive Evaluation Framework for LLMs On the Mixture of Code and Text

85% match2024

Cite this paper

@article{chen2024mastering,
  title  = {Mastering the Craft of Data Synthesis for CodeLLMs},
  author = {Meng Chen and Philip Arthur and Qianyu Feng and Cong Duy Vu Hoang and Yu-Heng Hong and Mahdi Kazemi Moghaddam and Omid Nezami and Thien Nguyen and Gioacchino Tangari and Duy Vu and Thanh Vu and Mark Johnson and Krishnaram Kenthapadi and Don Dharmasiri and Long Duong and Yuan-Fang Li},
  year   = {2024},
  eprint = {2411.00005},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.00005v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.00005.svg)](https://codeofpaper.com/paper/2411.00005)

Discussion