Foundations of Large Language Models

Tong Xiao, Jingbo Zhu
1/16/2025
cs.CLcs.AIcs.LG

No official code found. Best implementation: NiuTrans/ABigSurveyOfLLMs (351 stars, CC0-1.0, last commit 2025-02-19). 1 more below.

Abstract

This is a book about large language models. As indicated by the title, it primarily focuses on foundational concepts rather than comprehensive coverage of all cutting-edge technologies. The book is structured into five main chapters, each exploring a key area: pre-training, generative models, prompting, alignment, and inference. It is intended for college students, professionals, and practitioners in natural language processing and related fields, and can serve as a reference for anyone interested in large language models.

View on arXivView PDF

Code Implementations(2)

NiuTrans/ABigSurveyOfLLMsCommunity100%
CC0-1.0

A collection of 150+ surveys on LLMs

35126Mar 14, 20241 years agoCC0-1.0
NiuTrans/NLPBookTranslationsCommunity63%

Multilingual Translations of "Foundations of Large Language Models" and NLPBook.

28122Sep 4, 20251 years ago
large-language-modelsmultilingual-translationsnatural-language-processing

Similar Papers

History, Development, and Principles of Large Language Models-An Introductory Survey

91% match2024

A Primer on Large Language Models and their Limitations

90% match2024

Decoding Large-Language Models: A Systematic Overview of Socio-Technical Impacts, Constraints, and Emerging Questions

87% match2024

Large Language Models: A Survey

87% match2024

Theoretical and Methodological Framework for Studying Texts Produced by Large Language Models

87% match2024

A Comprehensive Survey on Integrating Large Language Models with Knowledge-Based Methods

87% match2025

Cite this paper

@article{xiao2025foundations,
  title  = {Foundations of Large Language Models},
  author = {Tong Xiao and Jingbo Zhu},
  year   = {2025},
  eprint = {2501.09223},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2501.09223v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2501.09223.svg)](https://codeofpaper.com/paper/2501.09223)

Discussion