Lyt når som helst, hvor som helst

Dyk ned i over 1 million e- og lydbøger samt podcasts.

  • Over 1 million titler
  • Eksklusive titler + Mofibo Originals
  • Download og nyd titler offline
  • Opsig når som helst
Prøv nu
DK - Details page - Device banner - 894x1036
Cover for promptfoo in CI: Regression Testing Prompts, Tools, and RAG Pipelines

promptfoo in CI: Regression Testing Prompts, Tools, and RAG Pipelines

Sprog
Engelsk
Format
Kategori

Fakta

"promptfoo in CI: Regression Testing Prompts, Tools, and RAG Pipelines"

Modern LLM systems fail in ways that traditional test suites rarely catch: prompts drift, tool calls silently change, retrieval quality degrades, and superficially good outputs conceal serious regressions. This book is for experienced engineers, platform teams, and technical leads who want to bring CI-grade discipline to prompt-driven systems. It treats promptfoo not as a convenience utility, but as an engineering framework for turning fragile LLM behavior into versioned, testable, reviewable contracts.

Across the book, readers learn how to design robust `promptfooconfig.yaml` specifications, build high-fidelity datasets, choose assertions that match real failure modes, and operationalize evaluations in CI/CD pipelines with artifacts, thresholds, and quality gates. It goes beyond simple prompt checks to cover tool and agent trajectory validation, RAG grounding and retrieval regressions, cost and flakiness control, and adversarial red-team workflows for prompt injection, tool abuse, and data leakage. The result is a practical blueprint for making LLM quality measurable, reproducible, and enforceable before release.

The treatment assumes fluency with software delivery, automated testing, and modern AI application architecture. Rather than simplifying the subject, it focuses on the operational details, design trade-offs, and maintenance patterns that matter in production environments, especially where models, prompts, and system boundaries evolve continuously.

© 2026 NobleTrex Press (E-bog): 6610001242435

Udgivelsesdato

E-bog: 16. maj 2026

Tags

    Vælg dit abonnement

    • Over 1 million titler

    • Download og nyd titler offline

    • Eksklusive titler + Mofibo Originals

    • Børnevenligt miljø (Kids Mode)

    • Det er nemt at opsige når som helst

    Den mest populære

    Premium

    For dig som lytter og læser ofte.

    129 kr. /måned

    • Eksklusivt indhold hver uge

    • Fri lytning til podcasts

    • Ingen binding

    Prøv gratis

    Unlimited

    For dig som lytter og læser ubegrænset.

    159 kr. /måned

    • Eksklusivt indhold hver uge

    • Fri lytning til podcasts

    • Ingen binding

    Start tilbuddet

    Family

    For dig som ønsker at dele historier med familien.

    Fra 179 kr. /måned

    • Fri lytning til podcasts

    • Kun 39 kr. pr. ekstra konto

    • Ingen binding

    Dig + 1 familiemedlem2 konti

    179 kr. /måned

    Prøv gratis

    Flex

    For dig som vil prøve Mofibo.

    89 kr. /måned

    • Gem op til 100 ubrugte timer

    • Eksklusivt indhold hver uge

    • Fri lytning til podcasts

    • Ingen binding

    Prøv gratis