DeepSeek C-Stream
7.8
A lightweight, locally-run LLM inference engine optimized for resource-constrained environments (laptops, edge devices) by streaming weights from NVMe storage. Allows developers to integrate powerful LLMs into applications without requiring significant RAM or GPU resources.
120h
mvp estimate
7.8
viability grade
0
views
technology stack
C#
PostgreSQL
Medium
inspired by
Running LLMs from 3.2GB RAM using C