← Writing · page 3 of 3

Performance

39 posts tagged performance.

Oct 20, 2026

How to Speed Up GitHub Actions CI: Caching, Sharding, Docker (2026)

A step-by-step guide to faster GitHub Actions in 2026: measure job timings, cancel stale runs, use setup-node, setup-python and setup-go caching, actions/cache v6, buildx type=gha layer caching, matrix test sharding and larger runners, plus a cache-miss troubleshooting table.

13 min
Oct 20, 2026

eBPF Explained (2026): Verifier, CO-RE, Cilium, Tetragon and sched_ext

What eBPF is in 2026 and how it works: the verifier and its 1 million instruction limit, CO-RE and BTF, Cilium 1.20 networking, Tetragon 1.7 enforcement, OBI and the OTel profiler, eBPF for Windows, sched_ext since Linux 6.12, and the real limitations.

11 min
Oct 20, 2026

Distributed Tracing Explained: traceparent, Sampling and Jaeger v2 (2026)

Distributed tracing in 2026, explained by an infrastructure engineer: spans, W3C traceparent propagation, head vs tail sampling in the OpenTelemetry Collector, Jaeger v2 after v1's end of life, Grafana Tempo 3, Zipkin's status, trace-to-logs correlation and what traces cost.

12 min
Oct 20, 2026

Continuous Profiling in 2026: OTel Profiles Alpha, eBPF Agents, Real Costs

Continuous profiling in 2026 explained: OpenTelemetry Profiles reached public alpha in March, the Elastic-donated eBPF profiler now ships as a Collector, Pyroscope 2.0 and Parca compared, the real overhead numbers, and how profiles turn into cloud savings.

13 min
Oct 20, 2026

How to Reduce AWS Lambda Cold Starts: Init Duration to SnapStart (2026)

Step-by-step guide to measuring and reducing AWS Lambda cold starts in 2026: read Init Duration, price the August 2025 INIT billing change, pick runtime and arm64, bundle and lazy-load, tune memory, enable SnapStart and provisioned concurrency, and fix common errors.

14 min
Sep 9, 2026

On-Device Inference in 2026: 160 Tokens a Second on a Laptop, a 2-Bit Model in Every iPhone, and the Bandwidth Arithmetic That Decides What Stays Local

What actually runs on the device now: Apple's 3B model trained at 2 bits and the WWDC26 framework that lets any model plug in, Gemini Nano inside AICore, Windows ML and the quiet replacement of Phi Silica, the NPU TOPS numbers and why they are the wrong metric, the small-model field from Gemma 4 E2B to Qwen3.5-2B to LFM2.5 with licences, measured decode speeds from Google's own tables and an independent phone benchmark, the runtimes (llama.cpp with multi-token prediction, LiteRT-LM, ExecuTorch 1.0, MLX), the memory-bandwidth arithmetic that predicts all of it, and the model-extraction attacks nobody has fixed. With commands to run one today.

14 min
Sep 7, 2026

LLM Inference in 2026: Prefill Is a Different Machine Now, and the KV Cache Has a Disk Tier

vLLM 0.28, SGLang on 400,000 GPUs, NVIDIA Dynamo 1.0 and llm-d in the CNCF all converged on the same architecture: split prefill from decode, route on cached prefixes, page the KV cache to CPU and SSD, and run MoE experts wide across a rack. What changed this year, with the papers, the flags, and the prices.

15 min
Sep 2, 2026

Sandbox Creation Time Benchmarks Measure Different Things

Every AI sandbox matrix has a creation time column spanning 0.79ms to 2.7s. That spread is definitional, not performance. Here's how to make it comparable.

10 min
Sep 2, 2026

I Measured Every Stage of My 179ms Firecracker Boot Path

Where every millisecond of a Firecracker create goes, measured on my own production fleet, plus why I refuse to stop the clock before the guest answers.

9 min