Stepped MoE: reducing memory movement in large mixture-of-experts models

(arxiv.org)

2 points | by arnav1993k 5 hours ago ago

2 comments