T
ToolShelf
NANO PEARL
// Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.

Nano PEARL

Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.

32EmergingActive
Stars
162
Last Commit
1mo ago
Updated
3w ago

What it does

Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.

Getting Started

git
git clone https://github.com/smart-lty/nano-PEARL

Platforms

πŸͺŸwindows🍎mac🐧linux

Install Difficulty

moderate

Built With

python

Community Reactions