Find articles, news, tools and templates by subject or by the work you need to do.
91 results for “Evaluate an agent” · 1–12
Guide · AI in production ·
An independent checkout request can contradict an agent’s recovery claim. This evaluation separates the agent’s evidence from the grader’s observations and includes a runnable Python example.
Read guide: Testing an incident-response agent against the service it must recoverCommentary · AI in production ·
Version checks, durable operation records and independent service checks give a production agent a recovery path when approval or execution becomes uncertain.
Read commentary: How production agents handle stale approvals and uncertain writesGuide · AI in production ·
A timed-out scaling request needs a durable record and destination-state checks. Reusable operational skills need to recover unfinished work as well as start it.
Read guide: Recovering an interrupted agent skillNews · Observability ·
Splunk’s September releases combine agent traces, evaluations and token-cost monitoring. A rejected incident summary shows how retries and human corrections affect the apparent saving.
Read news: Splunk connects agent activity, evaluation and cost monitoringExplainer · AI in production ·
Helion places CPU agent loops, token routing, GPU inference and supporting services in separate capacity zones that still share one task outcome.
Read explainer: AMD Helion separates agent execution from model inferenceNews · Observability ·
CloudWatch Omni combines service discovery, agent evaluations, traces and natural-language queries. Its spaces retain account and Region scope, shaping cross-service investigations.
Read news: CloudWatch Omni brings agent evaluations and telemetry into one workspaceGuide · AI in production ·
Connect logical tasks to every model and tool attempt, then measure cost and latency per accepted outcome without hiding failed or unknown work.
Read guide: Measuring retry amplification in AI agent workflowsExplainer · AI in production ·
Meet Pi, the open-source terminal agent built for people who want to shape their tools. Learn its history, uses, setup, model choices, costs and customization.
Read explainer: Pi.dev guide: the coding agent you can make your ownGuide · AI in production ·
OpenShell can stop an agent after Kubernetes has accepted its scaling request. Recovery then depends on the Deployment state, available replicas and customer-facing result.
Read guide: Recovering an agent task after OpenShell containmentNews · Platform engineering ·
AlloyDB’s preview gives read-only agent queries separate compute that scales to zero. Shared storage and the first query after idle time shape its value for incident investigation.
Read news: AlloyDB previews separate compute for agent queriesNews · AI in production ·
Antigravity’s SDK supports Gemma through LiteRT and compatible local model servers. A hybrid cloud planner offers another arrangement, with filenames and task descriptions sent off-device.
Read news: Antigravity brings local models to its agent SDKGuide · AI in production ·
Understand Hermes Agent, its origins, models, memory and skills. Choose a setup, try two checkable examples, and learn where its limits matter.
Read guide: Hermes Agent guide: what it is, when to use it, and how to get started