Guides

Step-by-step guides covering all major aspects of Tumult.

Guide Description
Experiment Format TOON experiment structure, all fields and provider types
Execution Flow Five-phase lifecycle, orchestration internals
CLI Reference All commands: run, validate, analyze, export, compliance
Statistical Baselines Data-derived tolerance methods: percentile, IQR, mean/stddev
Analytics Guide DuckDB SQL queries over experiment journals, Parquet export
SigNoz Bulk Import Backfill lake Parquet spans into SigNoz’s ClickHouse, bypassing the collector
Observability Setup OTel env vars, collector configs, Jaeger, Grafana, SigNoz
Grafana Stack Reference Tempo + Mimir + Loki stack: one compose file, translated metric names, LogQL/TraceQL examples
Load Testing Guide k6 integration with chaos experiments
MCP Guide The MCP server: annotations, structured output, tumult:// resources, and the run-to-ingest-to-recommend loop
ChaosGraph The typed chaos knowledge graph served to agents over MCP: node/edge model, the two query tools, and compact agent context that stays within token budgets (reproducible via make demo-proof)
Agentic Quickstart Fault injection for AI agents: scenario packs, contracts, replay
Agentic Live Clients Inject faults into Claude Code, Codex, OpenCode, and Copilot traffic
Agentic Cross-Client Observability Normalize agent telemetry onto one schema; two-sided spans and trace-nesting tiers per client
Agentic Recommendations Enhance tumult recommend with a local agent CLI (Claude Code, Codex); generate validated experiments
Agentic Observability OTel instrumentation for agent runs: spans, metrics, and trace capture for agentic scenarios
Agentic Scenarios Author and run agentic fault-injection scenario packs
Token Efficiency TOON vs JSON token costs; keeping agent context small
Topology Declared service topology, compliance lineage, and injection recommendations
Autopilot Policy-gated autonomous fault injection with audit-before-act decisions
Experiment Scheduling Recurring experiments and GameDays on a schedule
Production Deployment Deploy Tumult in production: binaries, containers, hardening
Platform Walkthrough Click-through of the Tumult web UI on the seeded demo: login → register → approve → run → e-stop → evidence pack, with screenshots
Windows Faults tumult-windows: native process-kill, CPU-stress, and firewall-blackhole faults, validated live against a Windows 11 guest

Table of contents


Tumult is open source under the Apache-2.0 license.