Skip to content

GitLab

Switch branch/tag
  1. 01 Jul, 2023 1 commit
    • lvhan028's avatar
      build turbomind (#35) · 35d64462
      lvhan028 authored 
      * build turbomind

* change namespace fastertransformer to turbomind

* change logger name
      35d64462
  3. 30 Jun, 2023 2 commits
  5. 29 Jun, 2023 1 commit
    • AllentDan's avatar
      Add webui (#27) · 0cc48011
      AllentDan authored 
      * add webui

* update readme

* resolve comments

* readme
      0cc48011
  7. 28 Jun, 2023 1 commit
    • tpoisonooo's avatar
      feat(src): add kv cache int8 quantization (#22) · cc93136e
      tpoisonooo authored 
      * feat(src): add int8 and compile passed

* feat(kernels): fix

* feat(llama): update kernel

* feat(src): add debug

* fix(kernel): k_cache use int8_t pointer

* style(llama): clean code

* feat(deploy.py): revert to enable fmha

* style(LlamaV2): clean code

* feat(deploy.py): add default quant policy
      cc93136e
  9. 25 Jun, 2023 1 commit
  11. 21 Jun, 2023 1 commit
  13. 20 Jun, 2023 1 commit
  15. 18 Jun, 2023 1 commit