In Stock
Hands-On LLM Serving and Optimization
Chi Wang
|
Paperback
€63.99
Collect 191 Reward Points
- Free Delivery from
- This Book Is Available Online Only
- Book Synopsis
- <p>Large language models (LLMs) are the reasoning engines of modern AI. Today, a major inflection point has arrived: as the world races to deploy AI at scale, model inference has moved to the center of the stack. Welcome to the inference era.</p> <p>Without proper optimization, however, LLMs can be expensive and slow to serve. <em>Hands-On LLM Serving and Optimization</em> is a comprehensive guide to the complexities of deploying and optimizing LLMs at scale.</p> <p>In this hands-on, engineering-focused book, authors Chi Wang and Peiheng Hu combine practical examples, code, and strategies for building robust, performant, and cost-efficient AI token factories. Whether you're building the LLM inference infrastructure or the applications that consume it, a deep understanding of LLM serving will make you a more effective, future-ready engineer as AI transforms how we work and build.</p> <ul> <li>Learn the foundations of model serving with core concepts, design paradigms, and industry best practices</li> <li>Understand the common challenges of hosting LLMs at scale</li> <li>Balance latency and throughput to meet the demands of AI applications and business requirements</li> <li>Host LLMs cost-effectively with practical, code-backed techniques</li> </ul> </p>
- About The Author
- Chi Wang is a director of engineering at Salesforce's Einstein AI group, with over 18 years of experience in artificial intelligence and distributed systems. He leads the development of large-scale AI platforms that enable model training, inference, and optimization for hundreds of internal teams and power AI capabilities used by millions of Salesforce customers. At Salesforce, Chi oversees multiple engineering teams focused on model inference and optimization, and data science platforms. His work spans building multi-tenant AI infrastructure, scaling distributed compute systems, and improving the performance and cost-efficiency of large language model workloads in production. Chi is the lead inventor on 12 patents across areas including model serving and optimization, data access control, and large-scale system design. He is also a passionate technical writer, focused on making complex AI systems practical and accessible for engineers.
- Product Details
-
- ISBN
- 9798341621497
- Format
- Paperback
- Publisher
- O'Reilly Media, (29 May 2026)
- Number of Pages
- 371
- Language
- English
- Dimensions
- 233 x 178 x 20 mm
- Categories: