Data Integrity Sentinel
6.5
A system that monitors ETL pipelines for silent failures, automatically generating detailed error reports within the output file itself, instead of just logging errors, ensuring data quality and rapid issue detection, inspired by the article about ETL failures.
120h
mvp estimate
6.5
viability grade
3
views
technology stack
Python
PostgreSQL
Medium
Easy
inspired by
Three ETL failure patterns I now write into the output file, not just the logs