NVIDIA measures the overhead of confidential inference
An eight-B200 test retained 96.1% to 98.2% of baseline output-token throughput with confidential computing enabled. Its software and workload define what that comparison covers.
AIOps
AI in production: tools, operating patterns, costs, and failure modes.
NVIDIA Topograph maps GPU connections for workload placement
Topograph publishes discovered topology as Kubernetes labels or Slurm configuration. Placement policies can use that map to trade a shorter communication path against a longer queue.
NewsAI in production
GPT-6 Sol and Luna change the agent cost calculation
GPT-6 Sol and Luna combine lower token rates with cache-write and cache-read pricing. A repeated prompt can cost less even though its first cached write carries a premium.
GuideAI in production
How to evaluate incident-response agents
Build repeatable cases and check recovery independently, with a runnable Python grader.
AI energy alliance backs data centers that can vary grid demand
The alliance supports storage, generation and flexible AI workloads as ways to change grid demand. For a scheduled evaluation, a safe pause can still miss the deadline the job serves.
NewsAI in production
Claude adds on-demand compaction for long-running agents
Claude’s on-demand compaction lets an application replace older conversation history with a signed summary. A conditional restart shows why the summary must preserve relationships between instructions.
NewsAI in production
Claude’s Chrome transcripts enter the enterprise audit trail
Claude Enterprise’s Compliance API beta now includes Chrome-session transcripts. Tool exchanges help locate an attempted action; the destination’s records establish whether it took effect.
NewsObservability
Splunk connects agent activity, evaluation and cost monitoring
Splunk’s September releases combine agent traces, evaluations and token-cost monitoring. A rejected incident summary shows how retries and human corrections affect the apparent saving.
GuideAI in production
Supervising coding agents with Herdr
How Herdr keeps coding sessions available while you detach, and what changes when its server restarts.
CommentaryIncident response
What MTTD misses
Separate detection from response and find delays that an improving average can conceal.
CommentaryAI in production
When agents can change production
The permissions, state and recovery paths an agent needs when its tool calls can change a running service.
ExplainerAI in production
The operational cost of AI tokens
Account for context limits, retries, latency, and the work behind a useful result.