Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?

Anishka, Atharva Mehta, Nipun Gupta, Aarav Balachandran, Dhruv Kumar +1 more
12/12/2023
cs.HCcs.AI

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

The emergence of Large language models (LLMs) is expected to have a major impact on education. This paper explores the potential of using ChatGPT, an LLM, as a virtual Teaching Assistant (TA) in an Introductory Programming Course. We evaluate ChatGPT's capabilities by comparing its performance with that of human TAs in some of the important TA functions. The TA functions which we focus on include (1) grading student code submissions, and (2) providing feedback to undergraduate students in an introductory programming course. Firstly, we assess ChatGPT's proficiency in grading student code submissions using a given grading rubric and compare its performance with the grades assigned by human TAs. Secondly, we analyze the quality and relevance of the feedback provided by ChatGPT. This evaluation considers how well ChatGPT addresses mistakes and offers suggestions for improvement in student solutions from both code correctness and code quality perspectives. We conclude with a discussion on the implications of integrating ChatGPT into computing education for automated grading, personalized learning experiences, and instructional support.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Exploring the Potential of Large Language Models to Generate Formative Programming Feedback

89% match2023

ChatGPT as a Solver and Grader of Programming Exams written in Spanish

89% match2024

ChatGPT in the Classroom: An Analysis of Its Strengths and Weaknesses for Solving Undergraduate Computer Science Questions

88% match2023

Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses

88% match2023

Utilizing ChatGPT in a Data Structures and Algorithms Course: A Teaching Assistant's Perspective

88% match2024

Performance of Large Language Models in a Computer Science Degree Program

88% match2023

Cite this paper

@article{anishka2023chatgpt,
  title  = {Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?},
  author = {Anishka and Atharva Mehta and Nipun Gupta and Aarav Balachandran and Dhruv Kumar and Pankaj Jalote},
  year   = {2023},
  eprint = {2312.07343},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2312.07343v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2312.07343.svg)](https://codeofpaper.com/paper/2312.07343)

Discussion