Better Call GPT, Comparing Large Language Models Against Lawyers

Lauren Martin, Nick Whitehouse, Stephanie Yiu, Lizzie Catterson, Rivindu Perera
1/24/2024
cs.CYcs.CL

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

This paper presents a groundbreaking comparison between Large Language Models and traditional legal contract reviewers, Junior Lawyers and Legal Process Outsourcers. We dissect whether LLMs can outperform humans in accuracy, speed, and cost efficiency during contract review. Our empirical analysis benchmarks LLMs against a ground truth set by Senior Lawyers, uncovering that advanced models match or exceed human accuracy in determining legal issues. In speed, LLMs complete reviews in mere seconds, eclipsing the hours required by their human counterparts. Cost wise, LLMs operate at a fraction of the price, offering a staggering 99.97 percent reduction in cost over traditional methods. These results are not just statistics, they signal a seismic shift in legal practice. LLMs stand poised to disrupt the legal industry, enhancing accessibility and efficiency of legal services. Our research asserts that the era of LLM dominance in legal contract review is upon us, challenging the status quo and calling for a reimagined future of legal workflows.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{martin2024better,
  title  = {Better Call GPT, Comparing Large Language Models Against Lawyers},
  author = {Lauren Martin and Nick Whitehouse and Stephanie Yiu and Lizzie Catterson and Rivindu Perera},
  year   = {2024},
  eprint = {2401.16212},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2401.16212v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2401.16212.svg)](https://codeofpaper.com/paper/2401.16212)

Discussion