1. 01 Jul, 2023 1 commit
    • AllentDan's avatar
      Add lint action (#32) · fe46dac2
      AllentDan authored
      * temp
      
      * fix lint
      
      * csrc->src
      
      * remove clang-format
      
      * skip .rst
      
      * skip doc
      
      * clang-format
      
      version
      
      version
      
      * mat_B
      fe46dac2
  2. 28 Jun, 2023 1 commit
    • tpoisonooo's avatar
      feat(src): add kv cache int8 quantization (#22) · cc93136e
      tpoisonooo authored
      * feat(src): add int8 and compile passed
      
      * feat(kernels): fix
      
      * feat(llama): update kernel
      
      * feat(src): add debug
      
      * fix(kernel): k_cache use int8_t pointer
      
      * style(llama): clean code
      
      * feat(deploy.py): revert to enable fmha
      
      * style(LlamaV2): clean code
      
      * feat(deploy.py): add default quant policy
      cc93136e
  3. 20 Jun, 2023 1 commit