Evaluating the Application of Large Language Models to Generate Feedback in Programming Education

Sven Jacobs, Steffen Jaschke
3/13/2024
cs.CLcs.AIcs.CY

No confident code implementation found for this paper. 5 possible matches can be shown below.

Abstract

This study investigates the application of large language models, specifically GPT-4, to enhance programming education. The research outlines the design of a web application that uses GPT-4 to provide feedback on programming tasks, without giving away the solution. A web application for working on programming tasks was developed for the study and evaluated with 51 students over the course of one semester. The results show that most of the feedback generated by GPT-4 effectively addressed code errors. However, challenges with incorrect suggestions and hallucinated issues indicate the need for further improvements.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 5 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Assessing Large Language Models for Automated Feedback Generation in Learning Programming Problem Solving

90% match1 repo12025

Evaluating Language Models for Generating and Judging Programming Feedback

87% match2024

On the application of Large Language Models for language teaching and assessment technology

87% match2023

Feedback-Generation for Programming Exercises With GPT-4

87% match2024

Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge

87% match2024

Comparing large language models and human programmers for generating programming code

86% match2024

Cite this paper

@article{jacobs2024evaluating,
  title  = {Evaluating the Application of Large Language Models to Generate Feedback in Programming Education},
  author = {Sven Jacobs and Steffen Jaschke},
  year   = {2024},
  eprint = {2403.09744},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.09744v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.09744.svg)](https://codeofpaper.com/paper/2403.09744)

Discussion