ChatGPT as a Solver and Grader of Programming Exams written in Spanish

Pablo Saborido-Fernández, Marcos Fernández-Pichel, David E. Losada
9/23/2024
cs.AI

No confident code implementation found for this paper.

Abstract

Evaluating the capabilities of Large Language Models (LLMs) to assist teachers and students in educational tasks is receiving increasing attention. In this paper, we assess ChatGPT's capacities to solve and grade real programming exams, from an accredited BSc degree in Computer Science, written in Spanish. Our findings suggest that this AI model is only effective for solving simple coding tasks. Its proficiency in tackling complex problems or evaluating solutions authored by others are far from effective. As part of this research, we also release a new corpus of programming tasks and the corresponding prompts for solving the problems or grading the solutions. This resource can be further exploited by other research teams.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Utilizing ChatGPT in a Data Structures and Algorithms Course: A Teaching Assistant's Perspective

86% match2024

"Give me the code" -- Log Analysis of First-Year CS Students' Interactions With GPT

86% match2024

Assessing AI Detectors in Identifying AI-Generated Code: Implications for Education

86% match2024

Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students

85% match2024

Large Language Models for Education and Research: An Empirical and User Survey-based Analysis

85% match2025

"ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses

84% match2024

Cite this paper

@article{saboridofernndez2024chatgpt,
  title  = {ChatGPT as a Solver and Grader of Programming Exams written in Spanish},
  author = {Pablo Saborido-Fernández and Marcos Fernández-Pichel and David E. Losada},
  year   = {2024},
  eprint = {2409.15112},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.15112v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.15112.svg)](https://codeofpaper.com/paper/2409.15112)

Discussion