Skip to content

feat(infiniop): add lightning_attention op (CPU + NVIDIA) for MiniMax - #1564

Open
y258dd wants to merge 2 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
y258dd:feat/minimax-lightning-attention
Open

feat(infiniop): add lightning_attention op (CPU + NVIDIA) for MiniMax#1564
y258dd wants to merge 2 commits into
InfiniTensor:InfiniLM-v0.2.9cfrom
y258dd:feat/minimax-lightning-attention

feat(lightning_attention): support fp16 and bf16 on CUDA

7bcaa62
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs