WIP: Assessing the Effectiveness of ChatGPT in Preparatory Testing Activities

Susmita Haldar, Mary Pierce, Luiz Fernando Capretz
3/5/2025
cs.SEcs.AI

No confident code implementation found for this paper.

Abstract

This innovative practice WIP paper describes a research study that explores the integration of ChatGPT into the software testing curriculum and evaluates its effectiveness compared to human-generated testing artifacts. In a Capstone Project course, students were tasked with generating preparatory testing artifacts using ChatGPT prompts, which they had previously created manually. Their understanding and the effectiveness of the Artificial Intelligence generated artifacts were assessed through targeted questions. The results, drawn from this in-class assignment at a North American community college indicate that while ChatGPT can automate many testing preparation tasks, it cannot fully replace human expertise. However, students, already familiar with Information Technology at the postgraduate level, found the integration of ChatGPT into their workflow to be straightforward. The study suggests that AI can be gradually introduced into software testing education to keep pace with technological advancements.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

A Review of Generative AI in Computer Science Education: Challenges and Opportunities in Accuracy, Authenticity, and Assessment

83% match2025

ChatGPT in Research and Education: Exploring Benefits and Threats

82% match2024

Adoption and Impact of ChatGPT in Computer Science Education: A Case Study on a Database Administration Course

82% match2024

Integrating Generative AI in BIM Education: Insights from Classroom Implementation

82% match2025

The Future of Software Testing: AI-Powered Test Case Generation and Validation

82% match2024

The Role of Artificial Intelligence and Machine Learning in Software Testing

82% match2024

Cite this paper

@article{haldar2025wip,
  title  = {WIP: Assessing the Effectiveness of ChatGPT in Preparatory Testing Activities},
  author = {Susmita Haldar and Mary Pierce and Luiz Fernando Capretz},
  year   = {2025},
  eprint = {2503.03951},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.03951v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.03951.svg)](https://codeofpaper.com/paper/2503.03951)

Discussion