Engineering Blog

2 min read

AI Agent Squad for Ops: One Complex Request, Multiple Agents in Action

How multiple agents collaborate on one complex incident: from finding slow traces to a joint AI squad analysis.

1Complex incidents: 5 tabs, 30 minutes of stitching

2am alert: “Why is checkout slowing down?” You need P99, slow traces, root cause, and an incident report.

The old way: Grafana → Jaeger → topology → hand-written summary. Charts everywhere, root cause nowhere — 20–30 minutes per round.

Searching for slow requests in trace list
Screenshot: hopping across systems, no evidence chain
Pain point: Monitoring gives data, not conclusions. Every tool is a separate hunt.

2DataBuff: one goal, an AI squad wires the evidence

Open-source AI Native OTel APM. OTel ingest + Doris storage + multi-agent troubleshooting.

In one line: orchestrate an AI squad to turn metrics, traces, and topology into an incident-ready report.
DataBuff three-component architecture
Screenshot: Ingest → Doris → Platform
Global service topology
Screenshot: global topology — agents judge blast radius

3Up and running in 5 minutes

curl -fsSL https://databuff.ai/databuff/ai-apm-install.sh | bash
Install success
Screenshot: one command install, Web UI URL in output

Open http://localhost:27403 (admin / Databuff@123)

Service overview
Screenshot: traffic-light service health overview

Settings → AI model — add your LLM API key:

AI model configuration
Screenshot: natural-language troubleshooting after API key setup

Demo data: curl -fsSL https://databuff.ai/databuff/ai-apm-demo-install.sh | bash

4Back to §1: multi-agent joint ops

Drop the §1 request into the AI chat — all 5 screenshots below are from one conversation (live demo).

State the goal — P99, traces, root cause, report in one message.

User enters complex troubleshooting request
Screenshot: full incident goal in one prompt

Brain dispatchesdispatchExpertTask to metrics + inspection experts.

AI brain dispatching experts
Screenshot: concurrent dispatch to metrics + inspection

Smart query — breaks down the 240ms entry span.

Metrics expert trace breakdown
Screenshot: trace latency breakdown — 240ms entry

Health inspection — topology + slow traces + metrics to find the bottleneck.

Inspection tool chain
Screenshot: inspect queryTraceList → queryMetricData

Deliver summary — remediation + incident report.

Recommendations and summary
Screenshot: P0 actions + brain-merged report
vs §1: 5 tabs, 30 minutes → one message, root-cause report in minutes.

5From manual stitching to commanding an AI squad

No more five browser tabs. Data stays local; code is open and auditable.

ModuleWhat you get
📊 APMTopology, P99, slow-trace drill-down
🤖 AI squadMulti-agent queries, synthesized reports
🔌 OTelUnified trace / metric / log storage

⭐ Deploy your ops AI squad in 5 minutes

curl -fsSL https://databuff.ai/databuff/ai-apm-install.sh | bash

Try: “Analyze why checkout slowed down and draft an incident report.”

View on GitHub →