Portable Rust AI Inference Server
7.0
A server application based on QORA and QORA-TTS, delivering a self-contained, single-executable LLM inference and text-to-speech solution suitable for edge devices or environments with limited resources.
100h
mvp estimate
7.0
viability grade
14
views
technology stack
Rust
Medium
inspired by
QORA is a portable Rust LLM inference engine with quantized weights.