Tracing an AI request through Cloudflare and its origin
Follow a slow AI request from Cloudflare to an instrumented origin, configure sampling, and verify that the trace preserves the evidence needed to investigate.
Guides, news and explanations about AI and reliable systems.
Follow a slow AI request from Cloudflare to an instrumented origin, configure sampling, and verify that the trace preserves the evidence needed to investigate.
Build a latency SLI from Prometheus histogram buckets, include failed requests, and compare classic and native queries with a worked search-service example.
A synthetic order-service incident follows a shared handoff through page edits, new findings and shift change, including the review and access work involved.
Tail sampling selects recorded traces by error, latency and other evidence. A checkout timeout shows how routing, waiting time and memory affect the trace a responder can retrieve.
CodeRabbit brings AI feedback into pull requests, editors and the CLI. A retry loop that exceeds its caller’s deadline shows the kind of finding that can repay review time.
OpenShell can stop an agent after Kubernetes has accepted its scaling request. Recovery then depends on the Deployment state, available replicas and customer-facing result.
A release-note digest and a changed maintenance event show two uses of Muse’s persistent agent: gathering information over time and preparing a connected-account update.
A durable queue can preserve telemetry through an outage, then take longer to catch up. Arrival rate, export capacity and event age explain what recovery looks like.
A missing response can leave a worker already created. Durable operation IDs and the destination’s idempotency contract let a replacement executor recover the original request.
Zero errors, no traffic and absent series produce different PromQL results. Synthetic tests show how ratios, fallback zeros and absence checks behave for a checkout service.
Plan an inference-service node drain with a scoped disruption budget, replacement-capacity checks and a practical maintenance worksheet.
What prompt-cache hits save once retries and failed work are included in task cost, with a local calculator and ledger.