CALM
// Official implementation of "Continuous Autoregressive Language Models"
Calm
Official implementation of "Continuous Autoregressive Language Models"
13EmergingUnknown
What it does
Modern Large Language Models (LLMs) are constrained by a fundamental bottleneck: they generate text one token at a time. CALM (Continuous Autoregressive Language Models) confronts this challenge by introducing a paradigm shift in language modeling. Instead of predicting one discrete token at a time, CALM learns to predict a single continuous vector that represents an entire chunk of K tokens.
Getting Started
git
git clone https://github.com/shaochenze/calm