Skip to content

GitLab

Commit 86dfa18d authored by flyingdown's avatar flyingdown
Browse files

replace distributed_fused_lamb.py

parent 719215bd
Expand all Hide whitespace changes
Inline Side-by-side
Showing with 49 additions and 238 deletions
cutlass @ ed2ed4d6
Compare ed2ed4d6...ed2ed4d6
Subproject commit ed2ed4d667ce95e1371bd62db32b6a114e774336
setup.py
View file @ 86dfa18d
......@@ -510,7 +510,7 @@ if "--fast_multihead_attn" in sys.argv or "--cuda_ext" in sys.argv:
cc_flag.append('-gencode')
cc_flag.append('arch=compute_86,code=sm_86')
subprocess.run(["git", "submodule", "update", "--init", "apex/contrib/csrc/multihead_attn/cutlass"])
#subprocess.run(["git", "submodule", "update", "--init", "apex/contrib/csrc/multihead_attn/cutlass"])
nvcc_args_mha = ['-O3',
'-gencode',
'arch=compute_70,code=sm_70',
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment