Skip to content

GitLab

Switch branch/tag
  1. 30 Jun, 2023 1 commit
  3. 29 Jun, 2023 1 commit
    • AllentDan's avatar
      Add webui (#27) · 0cc48011
      AllentDan authored 
      * add webui

* update readme

* resolve comments

* readme
      0cc48011
  5. 28 Jun, 2023 1 commit
    • tpoisonooo's avatar
      feat(src): add kv cache int8 quantization (#22) · cc93136e
      tpoisonooo authored 
      * feat(src): add int8 and compile passed

* feat(kernels): fix

* feat(llama): update kernel

* feat(src): add debug

* fix(kernel): k_cache use int8_t pointer

* style(llama): clean code

* feat(deploy.py): revert to enable fmha

* style(LlamaV2): clean code

* feat(deploy.py): add default quant policy
      cc93136e
  7. 25 Jun, 2023 1 commit
  9. 21 Jun, 2023 1 commit
  11. 20 Jun, 2023 1 commit
  13. 18 Jun, 2023 1 commit