NMOE
// MoE training for Me and You and maybe other people
Nmoe
MoE training for Me and You and maybe other people
13EmergingUnknown
What it does
\ / \ / \ | | | || | | | | | () | / || |||| || ||\/ \| sm100adocker/bash bash scripts/bootstrap.sh n speedrun n speedrunsuper${DATADIR:-/data}/speedrun/{train,val}${DATADIR:-/data}/eval/evalbundletargetloss=3.28LEADERBOARD.jsonfp8bf16bash n speedrun --leaderboard cat LEADERBOARD.json moonletbash make -C docker train docker run --gpus all -v /data:/data xjdr/nmoetrain:latest \ python -m nmoe.train
Getting Started
git
git clone https://github.com/Noumena-Network/nmoe