Developments that matter in production
What changed, how it works and what it means for the people running reliable systems.
44 stories · 25–36
How we reportCLM-8B embeds a situation and ranks supplied actions. Reusable candidate embeddings suit recurring choices, while the candidate list determines which answers are possible.
Background reading: AI in productionStorage Intelligence flags unusual storage usage and previews batch changes. A recurring dataset read shows why the job’s purpose matters when choosing which objects to move.
Background reading: Platform engineeringGoogle’s internal PageBreak agent proposes web vulnerabilities; separate validators test them in running applications. Reproductions can reduce the investigation work handed to developers.
Background reading: AI in productionAlloyDB’s preview gives read-only agent queries separate compute that scales to zero. Shared storage and the first query after idle time shape its value for incident investigation.
Background reading: Platform engineeringCloudWatch Omni combines service discovery, agent evaluations, traces and natural-language queries. Its spaces retain account and Region scope, shaping cross-service investigations.
Background reading: ObservabilityNVIDIA’s Cluster Readiness Engine runs diagnostic, communication and training workloads on selected nodes. Workload-specific thresholds turn those results into an admission decision.
Background reading: Platform engineeringNodeWright coordinates package, configuration and tuning changes across Kubernetes hosts. Progressive rollout and package verification organize the update one selected node group at a time.
Background reading: Platform engineeringAnthropic reports lower Opus task costs and new preserved-thinking behavior. A runbook exception provides a concrete comparison of the model’s reasoning and integration requirements.
Background reading: AI in productionNVIDIA reports generation falling from 156.6 to 34.2 seconds on its example workload. The eight-device layout also changes how much capacity remains for other requests.
Background reading: Platform engineeringSWE-Serve checks coding-agent patches through a running SGLang server. In NVIDIA’s experiment, adding live-serving checks reduced the pass rate for the same patches.
Background reading: AI in productionAntigravity’s SDK supports Gemma through LiteRT and compatible local model servers. A hybrid cloud planner offers another arrangement, with filenames and task descriptions sent off-device.
Background reading: AI in productionAn eight-B200 test retained 96.1% to 98.2% of baseline output-token throughput with confidential computing enabled. Its software and workload define what that comparison covers.
Background reading: Platform engineeringDevelopments since our original reporting, with dated updates and supporting sources.
New model documentation makes retained instructions and thinking-block compatibility part of the compaction migration review.
Original report: Claude adds on-demand compaction for long-running agents