- 19 Nov, 2023 1 commit
-
-
twaka authored
-
- 18 Nov, 2023 2 commits
-
-
Woosuk Kwon authored
-
Roy authored
-
- 16 Nov, 2023 4 commits
-
-
maximzubkov authored
-
twaka authored
-
Megha Agarwal authored
-
Zhuohan Li authored
TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622) Refactor the tensor parallelism, quantization, and weight-loading codes. Summary of the new features enabled by this PR: - **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580). - Model loading code became much simpler. - Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
-
- 13 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 12 Nov, 2023 1 commit
-
-
lirui authored
-
- 09 Nov, 2023 1 commit
-
-
forpanyang authored
-
- 07 Nov, 2023 1 commit
-
-
GoHomeToMacDonal authored
-
- 06 Nov, 2023 1 commit
-
-
Roy authored
-
- 03 Nov, 2023 2 commits
-
-
Antoni Baum authored
Signed-off-by:
Antoni Baum <antoni.baum@protonmail.com> Co-authored-by:
Viktor Ferenczi <viktor@ferenczi.eu> Co-authored-by:
Woosuk Kwon <woosuk.kwon@berkeley.edu>
-
Noam Gat authored
-
- 01 Nov, 2023 2 commits
-
-
Antoni Baum authored
-
Woosuk Kwon authored
-
- 31 Oct, 2023 1 commit
-
-
Wenfei Yan authored
-
- 30 Oct, 2023 1 commit
-
-
Antoni Baum authored
-
- 29 Oct, 2023 3 commits
-
-
Woosuk Kwon authored
-
ljss authored
-
Qing authored
-
- 22 Oct, 2023 1 commit
-
-
chooper1 authored
Co-authored-by:
squeeze-ai-lab <squeezeailab.bair@gmail.com> Co-authored-by:
-
- 20 Oct, 2023 1 commit
-
-
Wang Ran (汪然) authored
-
- 17 Oct, 2023 2 commits
-
-
Wang Ran (汪然) authored
-
Woosuk Kwon authored
-
- 16 Oct, 2023 2 commits
-
-
Zhuohan Li authored
Co-authored-by:Yunmo Chen <16273544+wanmok@users.noreply.github.com>
-
Woosuk Kwon authored
-
- 13 Oct, 2023 2 commits
-
-
Lu Wang authored
-
Woosuk Kwon authored
-
- 12 Oct, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 11 Oct, 2023 3 commits
-
-
amaleshvemula authored
-
twaka authored
-
yhlskt23 authored
-
- 10 Oct, 2023 1 commit
-
-
Zhuohan Li authored
-
- 02 Oct, 2023 3 commits
-
-
Zhuohan Li authored
-
Woosuk Kwon authored
-
Zhuohan Li authored
Co-authored-by:JiCheng <247153481@qq.com>
-
- 28 Sep, 2023 3 commits
-
-
Woosuk Kwon authored
-
Chris Bamford authored
Co-authored-by:timlacroix <t@mistral.ai>
-
Qing authored
-
