Skip to content

GitLab

Switch branch/tag
  1. 21 Nov, 2023 1 commit
  3. 20 Nov, 2023 1 commit
  5. 19 Nov, 2023 1 commit
  7. 16 Nov, 2023 1 commit
    • Zhuohan Li's avatar
      TP/quantization/weight loading refactor part 2 - Refactor quantized linear... · 7076fa1c
      Zhuohan Li authored 
      TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622)

Refactor the tensor parallelism, quantization, and weight-loading codes.

Summary of the new features enabled by this PR:
- **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580).
- Model loading code became much simpler.
- Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
      7076fa1c
  9. 02 Oct, 2023 1 commit
  11. 13 Sep, 2023 1 commit
  13. 07 Sep, 2023 1 commit
  15. 05 Sep, 2023 1 commit
  17. 03 Jul, 2023 1 commit
  19. 17 Jun, 2023 1 commit
  21. 25 May, 2023 1 commit
  23. 24 May, 2023 1 commit
  25. 19 May, 2023 1 commit
  27. 15 May, 2023 3 commits
  29. 09 May, 2023 1 commit
  31. 05 May, 2023 1 commit
  33. 04 May, 2023 1 commit
  35. 03 May, 2023 1 commit
  37. 28 Apr, 2023 1 commit
  39. 09 Apr, 2023 1 commit
  41. 02 Apr, 2023 2 commits
  43. 30 Mar, 2023 2 commits
  45. 21 Mar, 2023 1 commit
  47. 10 Mar, 2023 1 commit
  49. 25 Feb, 2023 1 commit
  51. 23 Feb, 2023 3 commits
  53. 22 Feb, 2023 1 commit
  55. 09 Feb, 2023 1 commit