Multi-agent evaluation platform

Find where your AI agents break before your users do.

Truvyx builds rigorous scenarios, enforces hard constraints, and runs root-cause analysis on multi-agent systems. Stop guessing whether your agents work, and prove it.

No credit card required. Free tier includes 50 evaluation runs per month.

evaluate.pytruvyx-sdk
Trusted by teams shipping agents inHealthcareIT OperationsLogisticsFinancial ServicesSupply Chain

The problem

Multi-agent systems fail in ways a single test never catches.

One agent misreads a constraint. Another hallucinates a dependency. Coordination breaks down three steps deep. By the time it surfaces in production, the cause is buried. Truvyx surfaces it on the first run.

7

fault types classified automatically

100%

of runs replayable as counterfactuals

RS256

signed, verifiable audit records

The platform

One workflow, from scenario to signed proof.

Scenario Studio

Author multi-agent test scenarios from natural language, then version and reuse them across every run.

Constraint Engine

Encode temporal, resource, and regulatory rules. A solver proves feasibility before any agent touches the task.

RCA Engine

When a run fails, trace the causal chain to the exact fault: decomposition, coordination, or constraint blindness.

Regression Monitoring

Watch every deploy. Catch score regressions and new fault types before they reach production.

Inside the platform

Four engines, one continuous loop of evidence.

Author

Turn a sentence into a machine-checkable scenario.

Describe the job in plain language. Scenario Studio expands it into typed agents, roles, dependencies, and success criteria you can version, fork, and replay.

  • Natural-language authoring with structured output
  • Versioned scenarios, diffed run-over-run
  • Reusable across teams and benchmarks
scenario-studio.yaml
|
Prove

Catch impossible tasks before an agent ever runs.

The Constraint Engine encodes temporal, resource, and regulatory rules, then a solver proves feasibility up front. No more burning a run on a task that was never satisfiable.

  • Temporal, resource, and regulatory constraints
  • Solver-backed feasibility proof
  • Hard and soft constraint tiers
constraint-engine.log
|
Diagnose

Know exactly why a run failed, not just that it did.

When a run breaks, the RCA Engine traces the causal chain to a single root fault and classifies it into one of seven fault types. Replay counterfactuals to confirm the fix.

  • Seven fault types classified automatically
  • Causal-chain tracing to the root node
  • Counterfactual replay for every run
rca-report.json
|
Defend

Guard production with continuous regression monitoring.

Wire monitoring into every deploy. Truvyx watches overall scores and emerging fault types, then alerts Slack, email, or PagerDuty the moment a regression appears.

  • Score and fault-type regression detection
  • Slack, SMTP, and PagerDuty notifications
  • Signed, verifiable audit records (RS256)
regression-alert.log
|

How it works

Three steps to evidence you can trust.

01

Define the scenario

Describe the task in plain language. Truvyx turns it into a machine-checkable spec with agents, roles, and constraints.

02

Run your agents

Submit any agent system through the SDK or UI. A sandboxed verifier scores feasibility, completeness, and optimality.

03

Diagnose and prove

Read the root-cause report, replay counterfactuals, and export a signed audit record for compliance.

Built for engineers

Wire evaluation into your pipeline in minutes.

Submit a run from CI, poll for the verdict, and gate your deploy on the score. The SDK speaks plain Python and returns structured results you can act on.

pip install truvyxtrk_live_…result.scores.overall
evaluate.pytruvyx-sdk

Ship agents you can defend in a review.

Start free, bring your own agents, and get a root-cause report on your first failing run.