Skip to content

[PyT] Disable FA3 for training when head_dim_qk != head_dim_v - #3490

Open
yuweih205 wants to merge 2 commits into
NVIDIA:mainfrom
yuweih205:fa3-mismatched-dims-training
Open

[PyT] Disable FA3 for training when head_dim_qk != head_dim_v#3490
yuweih205 wants to merge 2 commits into
NVIDIA:mainfrom
yuweih205:fa3-mismatched-dims-training

[PyT] Test FA3 mismatched-dimension mode selection

8b48c94
Select commit
Loading
Failed to load commit list.