chore: import upstream snapshot with attribution

This commit is contained in:
wehub-resource-sync
2026-07-13 13:18:33 +08:00
commit 4ececc111a
2017 changed files with 331736 additions and 0 deletions
+14
View File
@@ -0,0 +1,14 @@
Mixture of Experts (DeepSpeed MoE)
==================================
DeepSpeed provides two forms of MoE support: DeepSpeed MoE and :doc:`AutoEP
(Automatic Expert Parallelism) <autoep>`. DeepSpeed MoE is the explicit
``deepspeed.moe.layer.MoE`` API for constructing MoE layers in model code. This
page introduces the DeepSpeed MoE API.
See also the `Mixture of Experts (DeepSpeed MoE) tutorial
<https://www.deepspeed.ai/tutorials/mixture-of-experts/>`__ for training
examples and configuration details.
.. autoclass:: deepspeed.moe.layer.MoE
:members: