- 16 Nov, 2023 2 commits
-
-
Simon Mo authored
-
Zhuohan Li authored
TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622) Refactor the tensor parallelism, quantization, and weight-loading codes. Summary of the new features enabled by this PR: - **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580). - Model loading code became much simpler. - Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
-
- 11 Nov, 2023 1 commit
-
-
Dominik Schwabe authored
-
- 01 Nov, 2023 1 commit
-
-
ljss authored
-
- 30 Oct, 2023 1 commit
-
-
Dan Lord authored
-
- 22 Oct, 2023 1 commit
-
-
chooper1 authored
Co-authored-by:
squeeze-ai-lab <squeezeailab.bair@gmail.com> Co-authored-by:
Woosuk Kwon <woosuk.kwon@berkeley.edu>
-
- 17 Oct, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 16 Oct, 2023 1 commit
-
-
Zhuohan Li authored
Co-authored-by:Yunmo Chen <16273544+wanmok@users.noreply.github.com>
-
- 03 Oct, 2023 2 commits
-
-
Antoni Baum authored
-
Federico Cassano authored
Co-authored-by:Zhuohan Li <zhuohan123@gmail.com>
-
- 28 Sep, 2023 3 commits
-
-
Woosuk Kwon authored
-
Chris Bamford authored
Co-authored-by:timlacroix <t@mistral.ai>
-
Dan Lord authored
-
- 27 Sep, 2023 2 commits
-
-
Woosuk Kwon authored
-
Wang Ran (汪然) authored
Co-authored-by:
-
- 21 Sep, 2023 2 commits
-
-
Ricardo Lu authored
-
Woosuk Kwon authored
-
- 19 Sep, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 18 Sep, 2023 1 commit
-
-
Roy authored
-
- 17 Sep, 2023 2 commits
-
-
陈序 authored
-
Antoni Baum authored
-
- 16 Sep, 2023 1 commit
-
-
Woosuk Kwon authored
Co-authored-by:
Robert Irvine <robert@seamlessml.com> Co-authored-by:
root <rirv938@gmail.com> Co-authored-by:
Casper <casperbh.96@gmail.com> Co-authored-by:
julian-q <julianhquevedo@gmail.com>
-
- 15 Sep, 2023 1 commit
-
-
Jerry Yang authored
-
- 13 Sep, 2023 2 commits
-
-
Jasmond L authored
Co-authored-by:
Jasmond Loh <Jasmond.Loh@hotmail.com> Co-authored-by:
-
Antoni Baum authored
-
- 12 Sep, 2023 2 commits
-
-
Antoni Baum authored
-
leiwen83 authored
Signed-off-by:
Lei Wen <wenlei03@qiyi.com> Co-authored-by:
-
- 09 Sep, 2023 1 commit
-
-
Jingru authored
-
- 08 Sep, 2023 1 commit
-
-
Antoni Baum authored
Co-authored-by:
-
- 07 Sep, 2023 2 commits
-
-
Zhuohan Li authored
-
Antoni Baum authored
Signed-off-by:
Antoni Baum <antoni.baum@protonmail.com> Co-authored-by:
Avnish Narayan <38871737+avnishn@users.noreply.github.com>
-
- 06 Sep, 2023 1 commit
-
-
Antoni Baum authored
-
- 05 Sep, 2023 3 commits
-
-
Wen Sun authored
-
Antoni Baum authored
-
Zhuohan Li authored
-
- 04 Sep, 2023 1 commit
-
-
Antoni Baum authored
-
- 02 Aug, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 31 Jul, 2023 1 commit
-
-
Chaofan Lin authored
-
- 30 Jul, 2023 1 commit
-
-
Fang li authored
Co-authored-by:fangli <fangli@tencent.com>
-
- 28 Jul, 2023 1 commit
-
-
Xudong Zhang authored
-
