Turnstile
A Node.js framework for benchmarking AI agents in two simulated release scenarios. Compares baseline execution, reflection, and targeted feedback through paired runs, with counterfactual replay to verify proposed repairs.
Structured outputs and action validation keep runs bounded; a trajectory dashboard and JSON exports make success, attempts, and execution versus replay costs inspectable.