SHIMMY
// ⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, sing...
Shimmy
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, sing...
13EmergingUnknown
What it does
# The Lightweight OpenAI API Server ### 🔒 Local Inference Without Dependencies 🚀 Shimmy will be free forever. No asterisks. No "free for now." No pivot to paid. 🚀 If Shimmy helps you, consider sponsoring — 100% of support goes to keeping it free forever. - $5/month: Coffee tier ☕ - Eternal gratitude + sponsor badge - $25/month: Bug prioritizer 🐛 - Priority support + name in SPONSORS.md -
Getting Started
git
git clone https://github.com/Michael-A-Kuykendall/shimmy