Fix three memory defects in the Megatron path (selective_log_softmax, causal mask, discarded logits) - #283

Fix three memory defects in the Megatron path (selective_log_softmax, causal mask, discarded logits)#283

Wings-Of-Disaster wants to merge 3 commits into

modelscope:mainmodelscope/twinkle:mainfrom

Wings-Of-Disaster:fix/megatron-memory-leaksWings-Of-Disaster/twinkle:fix/megatron-memory-leaksCopy head branch name to clipboard