AI Revolution on Chat Bot: Evidence from a Randomized Controlled Experiment

Sida Peng, Wojciech Swiatek, Allen Gao, Paul Cullivan, Haoge Chang
1/19/2024
cs.HCcs.AIcs.IR

No confident code implementation found for this paper.

Abstract

In recent years, generative AI has undergone major advancements, demonstrating significant promise in augmenting human productivity. Notably, large language models (LLM), with ChatGPT-4 as an example, have drawn considerable attention. Numerous articles have examined the impact of LLM-based tools on human productivity in lab settings and designed tasks or in observational studies. Despite recent advances, field experiments applying LLM-based tools in realistic settings are limited. This paper presents the findings of a field randomized controlled trial assessing the effectiveness of LLM-based tools in providing unmonitored support services for information retrieval.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Rocks Coding, Not Development--A Human-Centric, Experimental Evaluation of LLM-Supported SE Tasks

87% match2024

The Use of Generative Search Engines for Knowledge Work and Complex Tasks

87% match2024

GOLF: Goal-Oriented Long-term liFe tasks supported by human-AI collaboration

85% match2024

Prompt Engineering and the Effectiveness of Large Language Models in Enhancing Human Productivity

85% match2025

The Evolution of LLM Adoption in Industry Data Curation Practices

85% match2024

SciSciGPT: Advancing Human-AI Collaboration in the Science of Science

85% match2025

Cite this paper

@article{peng2024revolution,
  title  = {AI Revolution on Chat Bot: Evidence from a Randomized Controlled Experiment},
  author = {Sida Peng and Wojciech Swiatek and Allen Gao and Paul Cullivan and Haoge Chang},
  year   = {2024},
  eprint = {2401.10956},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2401.10956v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2401.10956.svg)](https://codeofpaper.com/paper/2401.10956)

Discussion