MLOps

35 posts tagged mlops.

Nov 10, 2026

Why RAG Fails in Production (2026): 7 Failure Points and Real Fixes

Why RAG fails in production in 2026: chunking that falls off a 2.5k-token context cliff, retrieval misses that contextual retrieval plus reranking cut by 67%, stale and post-filtered vector indexes, permission leaks like EchoLeak, long context and agentic retrieval trade-offs, and evaluation gaps.

11 min
Nov 10, 2026

How to Deploy Ray Serve on Kubernetes with KubeRay 1.7 (2026)

Step-by-step guide to deploying Ray Serve on Kubernetes with KubeRay 1.7.2 and Ray 2.60.0: install the operator with Helm, write a batched Serve app, define a RayService, add autoscaling and GPU workers, run zero-downtime upgrades, and fix common errors.

12 min
Nov 10, 2026

Model Serving Frameworks 2026: Triton vs BentoML vs Ray Serve vs KServe

Model serving frameworks compared for 2026: Dynamo-Triton 2.74, BentoML 1.4.40 (now owned by Qualcomm via Modular), Ray Serve 2.60, KServe 0.21 and vLLM, with batching, multi-model, autoscaling, TorchServe's archived status, and when each one fits.

12 min
Nov 10, 2026

Airflow vs Kubeflow vs Prefect vs Dagster (2026): 6 Orchestrators Compared

Airflow 3.4, Kubeflow Pipelines 2.18, Prefect 3.9, Dagster 1.13, Flyte 2 and Metaflow compared for ML and data pipelines in 2026: assets vs tasks, Kubernetes fit, managed prices, and which team should pick which.

11 min
Nov 10, 2026

How to Evaluate a RAG Pipeline With Ragas 0.4.3: Step by Step (2026)

Evaluate a RAG pipeline with Ragas 0.4.3: install with working pins, build and review a test set, score faithfulness, context precision, context recall and answer relevancy, read the scores, gate pull requests in GitHub Actions, and control LLM-judge cost and bias.

13 min
Nov 10, 2026

How to Deploy Airflow 3 on Kubernetes with the Helm Chart (2026)

Step-by-step guide to running Apache Airflow 3.4 on Kubernetes with the official Helm chart 1.22.0: KubernetesExecutor vs Celery, git-sync Dags, external Postgres with PgBouncer, Vault secrets, KubernetesPodOperator and upgrading from Airflow 2.

14 min
Oct 31, 2026

How to Trace an LLM App with OpenTelemetry and Langfuse (2026)

Self-host Langfuse v4 with Docker Compose, instrument a Python tool-calling agent with the OpenTelemetry-based Langfuse SDK v5, track token cost, sessions and user feedback scores, route other services through an OTel Collector, and fix traces that never show up.

13 min
Oct 31, 2026

How to Get Reliable JSON From LLMs With Pydantic (2026)

Step-by-step guide to reliable JSON from LLMs in Python: Pydantic models, OpenAI responses.parse, Anthropic messages.parse, validation and retry loops, Instructor, streaming partial JSON, Ollama and vLLM, with tested versions and a troubleshooting table.

11 min
Oct 31, 2026

How to Install NVIDIA GPU Operator and Share GPUs: Time-Slicing, MIG (2026)

Step-by-step NVIDIA GPU Operator v26.7.2 install with Helm, verified with nvidia-smi and a CUDA test pod, then GPU sharing with a time-slicing ConfigMap or MIG profiles, DCGM Exporter metrics, and fixes for driver crash loops and nodes with no nvidia.com/gpu.

14 min
Oct 31, 2026

Model Drift Explained (2026): Data vs Concept Drift, PSI, KS and LLMs

Model drift explained for 2026: data drift vs concept drift vs prediction drift, how PSI, KS and Wasserstein behave at scale, why LLM quality drifts when providers retire snapshots, which tools still exist after WhyLabs and SageMaker Model Monitor, and when to retrain.

12 min
Oct 31, 2026

LLM Structured Outputs Explained (2026): JSON Mode vs Strict Schemas

What JSON mode, structured outputs and strict tool calling actually guarantee on OpenAI, Anthropic and Gemini in 2026, how constrained decoding works (XGrammar, llguidance, Outlines), the schema limits, and the ways valid JSON is still wrong.

12 min
Oct 31, 2026

LLM Observability Tools Compared (2026): Langfuse vs LangSmith vs Phoenix

Langfuse, LangSmith, Arize Phoenix, Helicone, Braintrust, Datadog and OpenLLMetry compared in October 2026: what each one bills on, list prices for a 300,000-run agent workload, licences and self-hosting, and how far the OpenTelemetry GenAI conventions have really got.

14 min
Oct 31, 2026

LLM Inference Engines 2026: vLLM vs SGLang vs TensorRT-LLM vs Dynamo

vLLM 0.32, SGLang 0.5.22, TensorRT-LLM 1.2.1 stable (1.4 in RC), Dynamo 1.6 and llama.cpp compared as of October 2026, with TGI now archived. How batching, PagedAttention and speculative decoding differ, what published benchmarks show, and which engine to pick.

11 min
Oct 31, 2026

GPUs on Kubernetes Explained (2026): Device Plugin, MIG, Time-Slicing, DRA

How GPUs on Kubernetes work in October 2026: the device plugin and nvidia.com/gpu, what GPU Operator v26.7.2 installs, MIG vs time-slicing vs MPS, DRA (GA since 1.34) and NVIDIA's DRA driver v0.5.1, Kueue quotas, EKS, GKE and AKS options, and why GPUs average 5% use.

14 min
Oct 31, 2026

Feature Stores Explained (2026): Online vs Offline, Feast, Tecton, LLMs

What a feature store does in 2026: online vs offline stores, point-in-time joins, training/serving skew, Feast 0.67, Tecton joining Databricks, Hopsworks, Vertex and SageMaker, and whether LLM apps and agents need one.

11 min