1. 19 Jul, 2023 2 commits
  2. 18 Jul, 2023 2 commits
  3. 14 Jul, 2023 1 commit
  4. 12 Jul, 2023 1 commit
  5. 11 Jul, 2023 2 commits
  6. 05 Jul, 2023 2 commits
    • lvhan028's avatar
      update internlm‘s chat template (#54) · 3de27ead
      lvhan028 authored
      * update internlm model
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update temperature, topk and top_p
      
      * update
      
      * update
      
      * loosen log level
      3de27ead
    • pppppM's avatar
      [Feature] Stats Quantization Parameters for KV Cache (#45) · 3fff964d
      pppppM authored
      * add cal qparams
      
      * support offload inference
      
      * add collect funtions (mod,weight)
      
      * stats kv scales
      
      * update init
      
      * add user guide
      
      * fix hints
      
      * fix comments & support turbomind format
      
      * update user guide
      
      * fix slice kv cache error & support pileval dataset (used in llm-awq)
      
      * fix wrong num heads slice
      
      * update default dataset
      
      * fix conflict
      
      * fix hints
      
      * fix hints
      
      * add gitignore
      3fff964d
  7. 04 Jul, 2023 2 commits
  8. 03 Jul, 2023 1 commit
  9. 01 Jul, 2023 1 commit
  10. 30 Jun, 2023 2 commits