Abstract: Recently, the sparsely-gated Mixture-Of-Experts (MoE) architecture has garnered significant attention. To benefit a wider audience, fine-tuning MoE models on more affordable clusters, which ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback