- 15 Dec, 2023 1 commit
-
-
q.yao authored
* Add bf16 template sp * prepare merge * add enable bf * add bf16 decode attention support * fix python lint * fix yapf * fix c format * c format11 * fix cast * fix on sm<80 * fix linux bf162 cast * fix type cast * fix lint * support from hf pretrained * fix pybind * fix converter * add trust remote code * fix comment * fix convert qwen * fix lint * fix baichuan * update weight map
-
- 18 Sep, 2023 1 commit
-
-
q.yao authored
* support actual seqlen * fix lint * update variable types * lint * update type * fix lint ---------
-
- 29 Aug, 2023 1 commit
-
-
q.yao authored
* first * fix causal mask * disable flash attention2 on sm70 * fix 2 * update readme * clang-format * disable ft2 on windows * fix lint * fix build * fix build * fix long kv seq * fix lint * sync copy output --------- Co-authored-by:
grimoire <yaoqian@pjlab.org.cn> Co-authored-by:
irexyc <irexyc@gmail.com>
-