- 01 Jul, 2023 4 commits
-
-
lvhan028 authored
-
lvhan028 authored
* change target tritonfastertransformerbackend to tritonturbomindbackend * install targets to backends/turbomind * changge model_dir
-
lvhan028 authored
* build turbomind * change namespace fastertransformer to turbomind * change logger name
-
AllentDan authored
* temp * fix lint * csrc->src * remove clang-format * skip .rst * skip doc * clang-format version version * mat_B
-
- 28 Jun, 2023 1 commit
-
-
tpoisonooo authored
* feat(src): add int8 and compile passed * feat(kernels): fix * feat(llama): update kernel * feat(src): add debug * fix(kernel): k_cache use int8_t pointer * style(llama): clean code * feat(deploy.py): revert to enable fmha * style(LlamaV2): clean code * feat(deploy.py): add default quant policy
-
- 20 Jun, 2023 1 commit
-
-
Li Zhang authored
* add ft code * gitignore * fix lint * revert fmha
-