LIBRISTO
LIBROAMANTO
mandatory
Become part of a community of book lovers from all over the world and get access to a whole bunch of benefits. Create an account for free
0
DPD courier 5.49 € GLS courier 10.49 €

Building Large Language Models from Scratch

Language EnglishEnglish
Book Paperback
Book Building Large Language Models from Scratch Dilyan Grigorov
Libristo code: 49881285
Publishers APRESS L.P., March 2026
This book is a complete, hands-on guide to designing, training, and deploying your own Large Languag... Full description
? points 138 b
56.48 €
Delivery after Christmas ▾ 50 % chance We search the world When will I receive my book?

Up to 30 days for returns


Customers also purchased


This book is a complete, hands-on guide to designing, training, and deploying your own Large Language Models (LLMs) from the foundations of tokenization to the advanced stages of fine-tuning and reinforcement learning. Written for developers, data scientists, and AI practitioners, it bridges core principles and state-of-the-art techniques, offering a rare, transparent look at how modern transformers truly work beneath the surface.

Starting from the essentials, you ll learn how to set up your environment with Python and PyTorch, manage datasets, and implement critical fundamentals such as tensors, embeddings, and gradient descent. You ll then progress through the architectural heart of modern models, covering RMS normalization, rotary positional embeddings (RoPE), scaled dot-product attention, Grouped Query Attention (GQA), Mixture of Experts (MoE), and SwiGLU activations, each explored in depth and built step by step in code. As you advance, the book introduces custom CUDA kernel integration, teaching you how to optimize key components for speed and memory efficiency at the GPU level an essential skill for scaling real-world LLMs. You ll also gain mastery over the phases of training that define today s leading models:

  • Pretraining - Building general linguistic and semantic understanding.
  • Midtraining - Expanding domain-specific capabilities and adaptability.
  • Supervised Fine-Tuning (SFT) - Aligning behavior with curated, task-driven data.
  • Reinforcement Learning from Human Feedback (RLHF) - Refining responses through reward-based optimization for human alignment.

The final chapters guide you through dataset preparation, filtering, deduplication, and training optimization, culminating in model evaluation and real-world prompting with a custom TokenGenerator for text generation and inference.

By the end of this book, you ll have the knowledge and confidence to architect, train, and deploy your own transformer-based models, equipped with both the theoretical depth and practical expertise to innovate in the rapidly evolving world of AI.

What You ll Learn

  • How to configure and optimize your development environment using PyTorch
  • The mechanics of tokenization, embeddings, normalization, and attention mechanisms.
  • How to implement transformer components like RMSNorm, RoPE, GQA, MoE, and SwiGLU from scratch.
  • How to integrate custom CUDA kernels to accelerate transformer computations.
  • The full LLM training pipeline: pretraining, midtraining, supervised fine-tuning, and RLHF.
  • Techniques for dataset preparation, deduplication, model debugging, and GPU memory management.
  • How to train, evaluate, and deploy a complete GPT-like architecture for real-world tasks.
Actress & Polyglot
EWA KASP for
Play video
Ewa Kasp
Libristo has the largest selection of foreign-language books. That’s why I buy my books there.

About the book

Full name Building Large Language Models from Scratch
Language English
Binding Book - Paperback
Date of issue 2026
Number of pages 264
EAN 9798868822964
Libristo code 49881285
Publishers APRESS L.P.
Weight 1033
Give this book today
It's easy
1 Add to cart and choose Deliver as present at the checkout 2 We'll send you a voucher 3 The book will arrive at the recipient's address

You might also be interested in


Top
Build a Large Language Model (from Scratch) Sebastian Raschka / Book Paperback
common.buy 59.08 €
Top
The Perks of Being a Wallflower Stephen Chbosky / Book Paperback
common.buy 8.99 €
LLM Engineer's Handbook Maxime Labonne / Book Paperback
common.buy 59.08 €
Top
Building Agentic AI Systems Wrick Talukdar / Book Paperback
common.buy 54.28 €
Building Large Language Models (LLM) Morteza SaberiKamarposhti / Book Paperback
common.buy 56.18 €
Top
Deep Learning Ian Goodfellow / Book Hardback
common.buy 96.77 €
Top
Clean Architecture Robert C. Martin / Book Paperback
common.buy 35.48 €
Top
Serious Cryptography, 2nd Edition AUMASSON JEAN PHILIPPE / Book Paperback
common.buy 45.88 €
Large Language Models: A Deep Dive Uday Kamath / Book Hardback
common.buy 59.88 €
Deep Learning For Dummies Mueller / Book Paperback
common.buy 27.18 €
Top
The Pragmatic Programmer David Thomas / Book Hardback
common.buy 41.48 €
Top
Alfred's Basic Adult All In One Course 1 Willard A. Palmer / Book Spiral bound
common.buy 17.19 €
Top
Code Charles Petzold / Book Paperback
common.buy 28.38 €
Military Heroism in a Post-Heroic Era Uzi Ben-Shalom / Book Hardback
common.buy 137.06 €
The Rose Arbor BOWEN RHYS / Book Paperback
common.buy 14.09 €
Top
Reasons Not to Worry Brigid Delaney / Book Paperback
common.buy 11.69 €
Top
Systema Self Defence Robert Poyton / Book Paperback
common.buy 17.69 €
Top
It: The Official Coloring Book Robert Lada / Book Paperback
common.buy 13.19 €
BX-ANIMORPHS RETRO TIN SET Scholastic / Book Paperback
common.buy 32.38 €
Deep Learning For Dummies John Paul Mueller / E-book Adobe ePub DRM
common.buy 28.98 €
Top
The Staff Engineer′s Path Tanya Reilly / Book Paperback
common.buy 35.38 €
Top
Prompt Engineering for Llms Albert Ziegler / Book Paperback
common.buy 60.78 €

Login

Log in to your account. Don't have a Libristo account? Create one now!

 
mandatory
mandatory

Don’t have an account? Discover the benefits of having a Libristo account!

With a Libristo account, you'll have everything under control.

Create a Libristo account
Book advisor Libroamiko
Hi, I'm Libroamiko, can I help?