CLI Run Ledger & Diff
Auto-record every command's parameters and outcome, and see exactly what changed between runs
- Problem
- When iterating on model experiments or data pipelines, developers often re-run the same command with tweaked parameters, then struggle to explain which parameter or environment caused a result change. They rely on memory or scattered notes, making reproduction and explanation costly.
- Solution
- A lightweight Python package that, whenever a command runs through it, automatically writes declared parameters, injected parameters, and environment info into a dependency-free ledger inside the project. A diff view highlights parameter and output changes between two runs, and commands can be replayed from the ledger.
- Users
- Algorithm engineers running quick experiments, data scientists, developers needing reproducible builds
- MVP
- Wrap commands to auto-record parameters, exit codes, and output hashes; local project ledger with no extra dependencies; CLI to diff two runs with highlighted differences; replay commands from the ledger
- Revenue
- Open-source core is free; team subscription adds shared ledger sync, web dashboard for run history, and collaborative annotations
- Why now
- AI and data experiments iterate faster than ever, driving demand for lightweight local-first reproducibility tools, while heavy experiment platforms are overkill for individual developers