Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models

Oana Ignat, Zhijing Jin, Artem Abzaliev, Laura Biester, Santiago Castro +17 more
5/21/2023
cs.CLcs.AI

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Recent progress in large language models (LLMs) has enabled the deployment of many generative NLP applications. At the same time, it has also led to a misleading public discourse that ``it's all been solved.'' Not surprisingly, this has, in turn, made many NLP researchers -- especially those at the beginning of their careers -- worry about what NLP research area they should focus on. Has it all been solved, or what remaining questions can we work on regardless of LLMs? To address this question, this paper compiles NLP research directions rich for exploration. We identify fourteen different research areas encompassing 45 research directions that require new research and are not directly solvable by LLMs. While we identify many research areas, many others exist; we do not cover areas currently addressed by LLMs, but where LLMs lag behind in performance or those focused on LLM development. We welcome suggestions for other research directions to include: https://bit.ly/nlp-era-llm

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{ignat2023been,
  title  = {Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models},
  author = {Oana Ignat and Zhijing Jin and Artem Abzaliev and Laura Biester and Santiago Castro and Naihao Deng and Xinyi Gao and Aylin Gunal and Jacky He and Ashkan Kazemi and Muhammad Khalifa and Namho Koh and Andrew Lee and Siyang Liu and Do June Min and Shinka Mori and Joan Nwatu and Veronica Perez-Rosas and Siqi Shen and Zekun Wang and Winston Wu and Rada Mihalcea},
  year   = {2023},
  eprint = {2305.12544},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.12544v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.12544.svg)](https://codeofpaper.com/paper/2305.12544)

Discussion