Skip to content

63

Articles

Featured Series

Latest Articles

AI Engineering••16 min read

Your LLM Provider Will Have an Outage: Circuit Breakers, Fallback Chains, and Degraded Modes

OpenAI and Anthropic both document outages, overload codes, and best-effort availability. The survival kit: LLM-aware circuit breakers, same-model-first fallback chains, and degraded modes designed before you need them.

#ai#llm#resilience
Your LLM Provider Will Have an Outage: Circuit Breakers, Fallback Chains, and Degraded Modes
Medium
AI Engineering
AI Engineering••24 min read

Designing a Multi-Agent Backend: The Orchestrator Pattern

Picture one agent, one context window, one serial loop — until it hits 180K tokens and silently drops 37 of the 40 services it was asked to audit. The orchestrator pattern fans work out to isolated sub-agents in parallel, then synthesizes. Here's the backend, in compiling Go.

#ai#llm#mcp
Designing a Multi-Agent Backend: The Orchestrator Pattern
Hard
AI Engineering
Backend Engineering••18 min read

Go 1.26 Green Tea GC in Production: What Changes, How to Measure It, When to Opt Out

Go 1.26 makes the Green Tea garbage collector the default. What actually changed, how to measure GC CPU before and after on your own workload, and the short window you have to opt out.

#go#performance#production
Go 1.26 Green Tea GC in Production: What Changes, How to Measure It, When to Opt Out
Medium
Backend Engineering
Backend Engineering••24 min read

JVM Cold Start in 2026: Leyden vs GraalVM Native Image vs CRaC

Slow JVM cold start breaks scale-to-zero and autoscaling. Three ways to fix it in 2026 — Project Leyden's AOT cache, GraalVM Native Image, and CRaC — with the exact commands, the trade-offs, and a decision framework.

#java#jvm#graalvm
JVM Cold Start in 2026: Leyden vs GraalVM Native Image vs CRaC
Hard
Backend Engineering
Backend Engineering••14 min read

Go context.Context Cheat Sheet: Cancellation, Timeouts & Gotchas

Go context.Context: constructors, cancellation, deadlines, request values, and five common gotchas, from leaked contexts to nil panics.

#go#context#concurrency
Go context.Context Cheat Sheet: Cancellation, Timeouts & Gotchas
Medium
Backend Engineering
Backend Engineering••11 min read

Kafka Producer Tuning Cheat Sheet: Throughput, Latency & Durability

Kafka producer configuration: acks, idempotence, batching, compression, and the tradeoffs that matter for throughput and durability.

#kafka#event-driven#distributed-systems
Kafka Producer Tuning Cheat Sheet: Throughput, Latency & Durability
Medium
Backend Engineering
Backend Engineering••12 min read

Postgres EXPLAIN Cheat Sheet: Reading Query Plans Like a Pro

Postgres EXPLAIN plans: node types, cost interpretation, and six query anti-patterns to avoid.

#postgresql#database-internals#performance
Postgres EXPLAIN Cheat Sheet: Reading Query Plans Like a Pro
Medium
Backend Engineering
AI Engineering••14 min read

Building an MCP Server in Go with Code Mode: From 1.17M Tokens to 1,000

Cloudflare put its 2,500+ API endpoints behind one MCP server with two tools, search + execute, and cut input tokens by 99.9%. The pattern in Go.

#llm#ai#mcp
Building an MCP Server in Go with Code Mode: From 1.17M Tokens to 1,000
Hard
AI Engineering
AI Engineering••13 min read

Securing AI Agent Infrastructure: MCP Servers, Tool Calls, and the Attack Surface You're Not Watching

AI agents calling tools via MCP create new attack surfaces: prompt injection through tool responses, credential leakage, and unauthorized execution.

#ai#security#llm
Securing AI Agent Infrastructure: MCP Servers, Tool Calls, and the Attack Surface You're Not Watching
Hard
AI Engineering
System Design••16 min read

Consistent Hashing: The Algorithm Behind Scalable Distributed Systems

Adding one cache server shouldn't invalidate every key. Consistent hashing with virtual nodes and bounded loads — full Go and Java implementations.

#consistent-hashing#distributed-systems#system-design
Consistent Hashing: The Algorithm Behind Scalable Distributed Systems
Medium
System Design