C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments

Pedro Orvalho, Mikoláš Janota, Vasco Manquinho
6/17/2022
cs.SEcs.AIcs.CY

Official code: pmorvalho/C-Pack-IPAs (10 stars, MIT, last commit 2026-05-31).

Abstract

Due to the vast number of students enrolled in Massive Open Online Courses (MOOCs), there has been an increasing number of automated program repair techniques focused on introductory programming assignments (IPAs). Such techniques take advantage of previous correct student implementations in order to provide automated, comprehensive, and personalized feedback to students. This paper presents C-Pack-IPAs, a publicly available benchmark of students' programs submitted for 25 different IPAs. C-Pack-IPAs contains semantically correct, semantically incorrect, and syntactically incorrect programs plus a test suite for each IPA. Hence, C-Pack-IPAs can be used to help evaluate the development of novel semantic, as well as syntactic, automated program repair frameworks, focused on providing feedback to novice programmers.

View on arXivView PDF

Code Implementations(1)

pmorvalho/C-Pack-IPAsOfficial100%
MIT

C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments (IPAs)

100C, MakefileMay 25, 20224 months agoMIT
cc-pack-ipascs101introduction-to-cintroduction-to-programming+5 more

Similar Papers

Automated Clustering and Program Repair for Introductory Programming Assignments

88% match1 repo462016

Peer-aided Repairer: Empowering Large Language Models to Repair Advanced Student Assignments

87% match2024

Counterexample Guided Program Repair Using Zero-Shot Learning and MaxSAT-based Fault Localization

86% match1 repo82024

Automating Autograding: Large Language Models as Test Suite Generators for Introductory Programming

82% match2024

Inappropriate Benefits and Identification of ChatGPT Misuse in Programming Tests: A Controlled Experiment

82% match2023

Feedback-Generation for Programming Exercises With GPT-4

81% match2024

Cite this paper

@article{orvalho2022cpack,
  title  = {C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments},
  author = {Pedro Orvalho and Mikoláš Janota and Vasco Manquinho},
  year   = {2022},
  eprint = {2206.08768},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/2206.08768}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2206.08768.svg)](https://codeofpaper.com/paper/2206.08768)

Discussion