LLM Shield

A security software designed to detect and mitigate side-channel attacks against Large Language Models (LLMs). It dynamically analyzes LLM inference patterns in real-time, identifying anomalies indicative of timing/other side-channel attacks, and adapts parameters to obscure these vulnerabilities.

technology stack

inspired by