Guides
Step-by-step guides covering all major aspects of Tumult.
| Guide | Description |
|---|---|
| Experiment Format | TOON experiment structure, all fields and provider types |
| Execution Flow | Five-phase lifecycle, orchestration internals |
| CLI Reference | All commands: run, validate, analyze, export, compliance |
| Statistical Baselines | Data-derived tolerance methods: percentile, IQR, mean/stddev |
| Analytics Guide | DuckDB SQL queries over experiment journals, Parquet export |
| SigNoz Bulk Import | Backfill lake Parquet spans into SigNoz’s ClickHouse, bypassing the collector |
| Observability Setup | OTel env vars, collector configs, Jaeger, Grafana, SigNoz |
| Grafana Stack | Reference Tempo + Mimir + Loki stack: one compose file, translated metric names, LogQL/TraceQL examples |
| Load Testing Guide | k6 integration with chaos experiments |
| MCP Guide | The MCP server: annotations, structured output, tumult:// resources, and the run-to-ingest-to-recommend loop |
| ChaosGraph | The typed chaos knowledge graph served to agents over MCP: node/edge model, the two query tools, and compact agent context that stays within token budgets (reproducible via make demo-proof) |
| Agentic Quickstart | Fault injection for AI agents: scenario packs, contracts, replay |
| Agentic Live Clients | Inject faults into Claude Code, Codex, OpenCode, and Copilot traffic |
| Agentic Cross-Client Observability | Normalize agent telemetry onto one schema; two-sided spans and trace-nesting tiers per client |
| Agentic Recommendations | Enhance tumult recommend with a local agent CLI (Claude Code, Codex); generate validated experiments |
| Agentic Observability | OTel instrumentation for agent runs: spans, metrics, and trace capture for agentic scenarios |
| Agentic Scenarios | Author and run agentic fault-injection scenario packs |
| Token Efficiency | TOON vs JSON token costs; keeping agent context small |
| Topology | Declared service topology, compliance lineage, and injection recommendations |
| Autopilot | Policy-gated autonomous fault injection with audit-before-act decisions |
| Experiment Scheduling | Recurring experiments and GameDays on a schedule |
| Production Deployment | Deploy Tumult in production: binaries, containers, hardening |
| Platform Walkthrough | Click-through of the Tumult web UI on the seeded demo: login → register → approve → run → e-stop → evidence pack, with screenshots |
| Windows Faults | tumult-windows: native process-kill, CPU-stress, and firewall-blackhole faults, validated live against a Windows 11 guest |
Table of contents
- Experiment Format
- Execution Flow
- CLI Reference
- Statistical Baselines
- Analytics Guide
- Observability Setup
- Load Testing Guide
- Agentic Fault Injection Quickstart
- Agentic Fault Injection Against Live Clients
- Agentic Observability
- Agentic Cross-Client Observability
- MCP Guide
- Agentic Scenarios
- Agentic Recommendations
- Token Efficiency
- ChaosGraph
- Topology
- Autopilot
- Experiment Scheduling
- Production Deployment
- Windows Faults
- Platform Walkthrough
- Grafana Stack
- SigNoz Bulk Import