"megatron/mpu/transformer.py" did not exist on "abe36e2e5fb9104eca2456945e12b49f93fce475"
-
q.yao authored
* first * fix causal mask * disable flash attention2 on sm70 * fix 2 * update readme * clang-format * disable ft2 on windows * fix lint * fix build * fix build * fix long kv seq * fix lint * sync copy output --------- Co-authored-by:
grimoire <yaoqian@pjlab.org.cn> Co-authored-by:
irexyc <irexyc@gmail.com>
452822a4
