Find articles, news, tools and templates by subject or by the work you need to do.
91 results for “Evaluate an agent” · 61–72
Guide · AI in production ·
Review the claim each test or document protects, challenge the evidence, and record a keep, rewrite or retire decision before deleting repository history.
Read guide: Auditing AI-generated tests and documentation before cleanupGuide · Observability ·
Run a candidate log classifier beside the current route, preserve complete outcomes, and promote only the slices whose mistakes and review cost are understood.
Read guide: Shadow-testing an AI log classifier before migrationNews · AI in production ·
Claude Haiku 5.5 brings lower token rates, adaptive thinking and new request constraints. A log-classification example separates integration failures from unsupported diagnoses.
Read news: Haiku 5.5 lowers prices and changes what a log classifier must handleGuide · Observability ·
A client-side SSE probe separates first answer text from normal completion. Fixed arrivals and outcome counts show whether a serving change delivers more useful answers.
Read guide: Measuring streaming LLM latency from first text to completed workGuide · AI in production ·
Instinct brings personal tasks into connected services. A hypothetical booking and notification worker show how permission, provider confirmation and uncertain results affect what happens next.
Read guide: Instinct: from a text or call to a confirmed taskNews · AI in production ·
A critical custom-flow template flaw affects customer-hosted AI Gateways. Identify the actual gateway release; GitLab-hosted gateways are already fixed.
Read news: GitLab urges self-hosted AI Gateway users to apply critical patchesNews · AI in production ·
Kolibri adds a customer-controlled bilingual model option. Its 3.46B active parameters come with about 78 GB of FP8 weights, plus memory for request state.
Read news: Aleph Alpha releases Kolibri for German and English workflowsGuide · Observability ·
Build a latency SLI from Prometheus histogram buckets, include failed requests, and compare classic and native queries with a worked search-service example.
Read guide: Measuring a latency SLO with Prometheus histogramsNews · Observability ·
Apigee separates model latency and token use from MCP tool traffic. Tool filters narrow a slow-assistant investigation, while proxy policies determine which charts populate.
Read news: Apigee adds model and MCP tool performance dashboardsGuide · Incident response ·
A synthetic order-service incident follows a shared handoff through page edits, new findings and shift change, including the review and access work involved.
Read guide: An SRE incident handoff in ChatGPT SpaceNews · AI in production ·
Anthropic’s 50 successful attempts and CAISI’s 61.1% score measure different things. Their task definitions explain what each assessment says about GLM-5.3.
Read news: Why GLM-5.3’s cyber assessments report different scoresNews · AI in production ·
A persistent assistant can gather context and prepare a dependency patch across conversations. The workspace and installed version determine what its test result means.
Read news: OpenAI Dots carries maintenance tasks between conversations