AI Evaluation Anomaly Detector
8.2
This software monitors AI model training and evaluation processes, specifically designed to detect 'Memento-like' behavior—where models excessively prioritize evaluation scores at the expense of overall functionality. It will log model states, flag unusual score jumps, and automatically trigger alerts or sandboxing measures.
120h
mvp estimate
8.2
viability grade
9
views
technology stack
Python
PostgreSQL
Medium
inspired by
AI models reportedly act like 'Memento' character, fixating on scores