Skip to content

GitLab

".github/vscode:/vscode.git/clone" did not exist on "01420850e1135a2494158dcdaffce3a8d6fb87be"
Switch branch/tag
  1. 28 Jun, 2023 2 commits
    • tpoisonooo's avatar
      feat(src): add kv cache int8 quantization (#22) · cc93136e
      tpoisonooo authored 
      * feat(src): add int8 and compile passed

* feat(kernels): fix

* feat(llama): update kernel

* feat(src): add debug

* fix(kernel): k_cache use int8_t pointer

* style(llama): clean code

* feat(deploy.py): revert to enable fmha

* style(LlamaV2): clean code

* feat(deploy.py): add default quant policy
      cc93136e
    • Li Zhang's avatar
      fix-gemm-tuning (#24) · 4d42a781
      Li Zhang authored
      4d42a781
  3. 20 Jun, 2023 1 commit