Learning from Teaching Assistants to Program with Subgoals: Exploring the Potential for AI Teaching Assistants

Changyoon Lee, Junho Myung, Jieun Han, Jiho Jin, Alice Oh
9/19/2023
cs.HCcs.AI

No confident code implementation found for this paper.

Abstract

With recent advances in generative AI, conversational models like ChatGPT have become feasible candidates for TAs. We investigate the practicality of using generative AI as TAs in introductory programming education by examining novice learners' interaction with TAs in a subgoal learning environment. To compare the learners' interaction and perception of the AI and human TAs, we conducted a between-subject study with 20 novice programming learners. Learners solve programming tasks by producing subgoals and subsolutions with the guidance of a TA. Our study shows that learners can solve tasks faster with comparable scores with AI TAs. Learners' perception of the AI TA is on par with that of human TAs in terms of speed and comprehensiveness of the replies and helpfulness, difficulty, and satisfaction of the conversation. Finally, we suggest guidelines to better design and utilize generative AI as TAs in programming education from the result of our chat log analysis.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Learning from a Generative AI Predecessor -- The Many Motivations for Interacting with Conversational Agents

87% match2023

Breaking the Programming Language Barrier: Multilingual Prompting to Empower Non-Native English Learners

87% match2024

Kattis vs. ChatGPT: Assessment and Evaluation of Programming Tasks in the Age of Artificial Intelligence

87% match2023

Will Code Remain a Relevant User Interface for End-User Programming with Generative AI Models?

87% match2023

How Do Programming Students Use Generative AI?

86% match2025

Enhancing Programming Error Messages in Real Time with Generative AI

86% match2024

Cite this paper

@article{lee2023learning,
  title  = {Learning from Teaching Assistants to Program with Subgoals: Exploring the Potential for AI Teaching Assistants},
  author = {Changyoon Lee and Junho Myung and Jieun Han and Jiho Jin and Alice Oh},
  year   = {2023},
  eprint = {2309.10419},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2309.10419v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2309.10419.svg)](https://codeofpaper.com/paper/2309.10419)

Discussion