PeerLLM Mirror

A distributed, peer-to-peer LLM inference engine leveraging a Napster-like model to reduce infrastructure costs and latency. Users can access large language models without downloading the entire model, instead retrieving only the necessary bytes on-demand from a network of peers.

technology stack

inspired by