← back to ideas

AutoML Experiment Auditor

6.9
devtools speculative added: Monday March 2026 06:26

An open-source tool, similar to Karpathy's AutoResearch, that automates the process of ML experiment tracking and analysis. Focuses on running ML experiments on tabular data indefinitely, and comparing their effectiveness as implementations improve. Collects data from popular ML frameworks and allows for visualization and comparison of experiment results.

220h
mvp estimate
6.9
viability grade
3
views

technology stack

Python PostgreSQL Medium

inspired by

Autonomous ML agent runs indefinitely