Skip to content

[PyTorch] DeepSeekV3Layer: full MoE transformer layer (MLA + DeepSeek MoE) - #3471

Open
pggPL wants to merge 46 commits into
NVIDIA:mainfrom
pggPL:deepseek_v3_layer
Open

[PyTorch] DeepSeekV3Layer: full MoE transformer layer (MLA + DeepSeek MoE)#3471
pggPL wants to merge 46 commits into
NVIDIA:mainfrom
pggPL:deepseek_v3_layer