Skip to content

GitLab

Switch branch/tag
  1. 30 Nov, 2023 1 commit
  3. 29 Nov, 2023 1 commit
  5. 24 Nov, 2023 1 commit
  7. 20 Nov, 2023 1 commit
  9. 19 Nov, 2023 1 commit
  11. 16 Nov, 2023 1 commit
    • Zhuohan Li's avatar
      TP/quantization/weight loading refactor part 2 - Refactor quantized linear... · 7076fa1c
      Zhuohan Li authored 
      TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622)

Refactor the tensor parallelism, quantization, and weight-loading codes.

Summary of the new features enabled by this PR:
- **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580).
- Model loading code became much simpler.
- Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
      7076fa1c
  13. 02 Oct, 2023 1 commit
  15. 20 Sep, 2023 1 commit
  17. 13 Sep, 2023 1 commit
  19. 07 Sep, 2023 1 commit
  21. 05 Sep, 2023 1 commit
  23. 30 Aug, 2023 1 commit
  25. 02 Aug, 2023 1 commit
  27. 01 Aug, 2023 1 commit
  29. 17 Jul, 2023 1 commit
  31. 14 Jul, 2023 1 commit
  33. 03 Jul, 2023 1 commit
  35. 17 Jun, 2023 1 commit
  37. 24 May, 2023 1 commit
  39. 19 May, 2023 1 commit
  41. 15 May, 2023 3 commits
  43. 09 May, 2023 1 commit
  45. 05 May, 2023 1 commit
  47. 04 May, 2023 1 commit
  49. 03 May, 2023 1 commit
  51. 28 Apr, 2023 1 commit
  53. 09 Apr, 2023 1 commit
  55. 02 Apr, 2023 2 commits
  57. 31 Mar, 2023 1 commit
  59. 30 Mar, 2023 2 commits