Lyt når som helst, hvor som helst

Dyk ned i over 1 million e- og lydbøger samt podcasts.

  • Over 1 million titler
  • Eksklusive titler + Mofibo Originals
  • Download og nyd titler offline
  • Opsig når som helst
Prøv nu
DK - Details page - Device banner - 894x1036
Cover for llama.cpp in the Real World: On‑Device LLM Inference, Profiling, and Deployment

llama.cpp in the Real World: On‑Device LLM Inference, Profiling, and Deployment

Sprog
Engelsk
Format
Kategori

Fakta

"llama.cpp in the Real World: On‑Device LLM Inference, Profiling, and Deployment"

Large language models no longer belong only in hyperscale clouds. This book is for experienced engineers, systems programmers, ML infrastructure practitioners, and advanced application developers who need to run LLMs locally with rigor, not folklore. Centered on llama.cpp, it treats on-device inference as a serious engineering discipline: one shaped by hardware limits, fast-moving runtime capabilities, reproducibility demands, and real operational trade-offs.

Readers will learn how llama.cpp is structured as an inference stack, why GGUF defines the deployment boundary, and how backend selection, build strategy, quantization, context sizing, and KV-cache planning interact to determine feasibility and performance. The book then moves into repeatable benchmarking, runtime tuning, server deployment through local APIs, multi-user serving behavior, structured outputs, embeddings, reranking, and production-grade observability. Throughout, it emphasizes evidence-based decisions, compatibility awareness, and benchmark methodology that survives version churn.

Rather than offering shallow setup recipes, this book provides a deep, system-level treatment of local LLM deployment in the real world. Familiarity with C/C++ build environments, model-serving concepts, and modern ML tooling will help readers get the most from it, but the presentation remains self-contained and operationally focused.

© 2026 NobleTrex Press (E-bog): 6610001219116

Udgivelsesdato

E-bog: 8. maj 2026

Tags

    Vælg dit abonnement

    • Over 1 million titler

    • Download og nyd titler offline

    • Eksklusive titler + Mofibo Originals

    • Børnevenligt miljø (Kids Mode)

    • Det er nemt at opsige når som helst

    Den mest populære

    Premium

    For dig som lytter og læser ofte.

    129 kr. /måned

    • Eksklusivt indhold hver uge

    • Fri lytning til podcasts

    • Ingen binding

    Prøv gratis

    Unlimited

    For dig som lytter og læser ubegrænset.

    159 kr. /måned

    • Eksklusivt indhold hver uge

    • Fri lytning til podcasts

    • Ingen binding

    Start tilbuddet

    Family

    For dig som ønsker at dele historier med familien.

    Fra 179 kr. /måned

    • Fri lytning til podcasts

    • Kun 39 kr. pr. ekstra konto

    • Ingen binding

    Dig + 1 familiemedlem2 konti

    179 kr. /måned

    Prøv gratis

    Flex

    For dig som vil prøve Mofibo.

    89 kr. /måned

    • Gem op til 100 ubrugte timer

    • Eksklusivt indhold hver uge

    • Fri lytning til podcasts

    • Ingen binding

    Prøv gratis