• FoolPlayer's avatar
    [shardformer] support SAM (#4231) · dd2bf026
    FoolPlayer authored
    * 1.support sam 2.add fused qkv for nn.Linear
    
    * update utils support set element in list
    
    * overtwrite SamVisionAttention foward to use DropoutForParallelInput
    
    * remove unused code
    dd2bf026
sam.py 1.86 KB