Disrupting Test Development with AI Assistants

Vijay Joshi, Iver Band
11/4/2024
cs.SEcs.AI

No confident code implementation found for this paper.

Abstract

Recent advancements in large language models, including GPT-4 and its variants, and Generative AI-assisted coding tools like GitHub Copilot, ChatGPT, and Tabnine, have significantly transformed software development. This paper analyzes how these innovations impact productivity and software test development metrics. These tools enable developers to generate complete software programs with minimal human intervention before deployment. However, thorough review and testing by developers are still crucial. Utilizing the Test Pyramid concept, which categorizes tests into unit, integration, and end-to-end tests, we evaluate three popular AI coding assistants by generating and comparing unit tests for opensource modules. Our findings show that AI-generated tests are of equivalent quality to original tests, highlighting differences in usage and results among the tools. This research enhances the understanding and capabilities of AI-assistant tools in automated testing.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Examination of Code generated by Large Language Models

85% match2024

Transforming Software Development: Evaluating the Efficiency and Challenges of GitHub Copilot in Real-World Projects

84% match2024

A System for Automated Unit Test Generation Using Large Language Models and Assessment of Generated Test Suites

84% match2024

Impact of Code Context and Prompting Strategies on Automated Unit Test Generation with Modern General-Purpose Large Language Models

84% match1 repo42025

Comparing large language models and human programmers for generating programming code

84% match2024

You Name It, I Run It: An LLM Agent to Execute Tests of Arbitrary Projects

84% match1 repo732024

Cite this paper

@article{joshi2024disrupting,
  title  = {Disrupting Test Development with AI Assistants},
  author = {Vijay Joshi and Iver Band},
  year   = {2024},
  eprint = {2411.02328},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.02328v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.02328.svg)](https://codeofpaper.com/paper/2411.02328)

Discussion