Advances in Large Language Model

Abstract

A large language model (LLM) is an AI model (typically a neural network) trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts. They are the basis for many modern chatbots, such as ChatGPT, Claude, Gemini, Grok, and DeepSeek. LLMs are typically based on transformer architecture. Generative pre-trained transformers (GPTs) are a type of LLM that is pre-trained to predict the next word. GPTs are then often fine-tuned to follow instructions and to behave as assistants. In the present book, ten typical literatures about large language model published on international authoritative journals were selected to introduce the worldwide newest progress, which contains reviews or original researches on large language model. We hope this book can demonstrate advances in large language model as well as give references to the researchers, students and other related people.