Evaluating Large Language Models for the Generation of Unit Tests with Equivalence Partitions and Boundary Values

Martín Rodríguez, Gustavo Rossi, Alejandro Fernandez
5/14/2025
cs.SEcs.AI

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

The design and implementation of unit tests is a complex task many programmers neglect. This research evaluates the potential of Large Language Models (LLMs) in automatically generating test cases, comparing them with manual tests. An optimized prompt was developed, that integrates code and requirements, covering critical cases such as equivalence partitions and boundary values. The strengths and weaknesses of LLMs versus trained programmers were compared through quantitative metrics and manual qualitative analysis. The results show that the effectiveness of LLMs depends on well-designed prompts, robust implementation, and precise requirements. Although flexible and promising, LLMs still require human supervision. This work highlights the importance of manual qualitative analysis as an essential complement to automation in unit test evaluation.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{rodrguez2025evaluating,
  title  = {Evaluating Large Language Models for the Generation of Unit Tests with Equivalence Partitions and Boundary Values},
  author = {Martín Rodríguez and Gustavo Rossi and Alejandro Fernandez},
  year   = {2025},
  eprint = {2505.09830},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2505.09830v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2505.09830.svg)](https://codeofpaper.com/paper/2505.09830)

Discussion