Name		Name	Last commit message	Last commit date
Latest commit History 11 Commits
LICENSE		LICENSE
README.md		README.md
data.py		data.py
model.py		model.py
train.py		train.py

Repository files navigation

supervised-routing-moe

Code for the work on label-supervised routing in MoE: https://souvikshanku.github.io/blog/supervised-routing/

About

Label-Supervised Routing in Upcycled Mixture of Experts

souvikshanku.github.io/blog/supervised-routing/

upcycling mixture-of-experts supervised-routing

1 star

0 watching

Report repository

Contributors

Languages

Python 100.0%