Skip to content

GitLab

Switch branch/tag
  1. 07 Dec, 2023 1 commit
  3. 30 Nov, 2023 1 commit
  5. 29 Nov, 2023 1 commit
  7. 20 Nov, 2023 1 commit
  9. 19 Nov, 2023 1 commit
  11. 16 Nov, 2023 1 commit
    • Zhuohan Li's avatar
      TP/quantization/weight loading refactor part 2 - Refactor quantized linear... · 7076fa1c
      Zhuohan Li authored 
      TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622)

Refactor the tensor parallelism, quantization, and weight-loading codes.

Summary of the new features enabled by this PR:
- **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580).
- Model loading code became much simpler.
- Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
      7076fa1c
  13. 29 Oct, 2023 1 commit
  15. 02 Oct, 2023 1 commit
  17. 20 Sep, 2023 1 commit
  19. 13 Sep, 2023 1 commit
  21. 07 Sep, 2023 1 commit
  23. 05 Sep, 2023 1 commit
  25. 30 Aug, 2023 1 commit
  27. 11 Aug, 2023 1 commit
  29. 08 Aug, 2023 1 commit
  31. 20 Jul, 2023 1 commit
  33. 14 Jul, 2023 1 commit
  35. 03 Jul, 2023 1 commit
  37. 17 Jun, 2023 1 commit
  39. 24 May, 2023 1 commit
  41. 19 May, 2023 1 commit
  43. 15 May, 2023 3 commits
  45. 09 May, 2023 1 commit
  47. 05 May, 2023 1 commit
  49. 04 May, 2023 1 commit
  51. 03 May, 2023 1 commit
  53. 28 Apr, 2023 1 commit
  55. 09 Apr, 2023 1 commit
  57. 02 Apr, 2023 2 commits
  59. 31 Mar, 2023 1 commit
  61. 30 Mar, 2023 2 commits