- 14 Mar, 2024 1 commit
-
-
陈序 authored
Co-authored-by:Cade Daniel <edacih@gmail.com>
-
- 13 Mar, 2024 1 commit
-
-
Bo-Wen Wang authored
Co-authored-by:Woosuk Kwon <woosuk.kwon@berkeley.edu>
-
- 11 Mar, 2024 2 commits
-
-
Zhuohan Li authored
-
Zhuohan Li authored
-
- 04 Mar, 2024 2 commits
-
-
Antoni Baum authored
Co-authored-by:Avnish Narayan <avnish@anyscale.com>
-
Philipp Moritz authored
Co-authored-by:Roger Wang <136131678+ywang96@users.noreply.github.com>
-
- 02 Mar, 2024 2 commits
-
-
Sage Moore authored
Co-authored-by:
ElizaWszola <eliza@neuralmagic.com> Co-authored-by:
Michael Goin <michael@neuralmagic.com>
-
cloudhan authored
-
- 01 Mar, 2024 2 commits
-
-
Allen.Dou authored
Co-authored-by:
zixiao <shunli.dsl@alibaba-inc.com> Co-authored-by:
Simon Mo <simon.mo@hey.com>
-
Robert Shaw authored
Co-authored-by:
Robert Shaw <114415538+rib-2@users.noreply.github.com> Co-authored-by:
alexm <alexm@neuralmagic.com>
-
- 29 Feb, 2024 1 commit
-
-
Allen.Dou authored
-
- 28 Feb, 2024 1 commit
-
-
Liangfu Chen authored
-
- 22 Feb, 2024 1 commit
-
-
zhaoyang-star authored
-
- 18 Feb, 2024 1 commit
-
-
Mark Mozolewski authored
-
- 08 Feb, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 06 Feb, 2024 1 commit
-
-
liuyhwangyh authored
-
- 01 Feb, 2024 1 commit
-
-
Kunshang Ji authored
Co-authored-by:
Jiang Li <jiang1.li@intel.com> Co-authored-by:
Kunshang Ji <kunshang.ji@intel.com>
-
- 31 Jan, 2024 1 commit
-
-
zspo authored
-
- 29 Jan, 2024 1 commit
-
-
zhaoyang-star authored
Co-authored-by:
zhaoyang <zhao.yang16@zte.com.cn> Co-authored-by:
Zhuohan Li <zhuohan123@gmail.com>
-
- 27 Jan, 2024 2 commits
-
-
Hanzhi Zhou authored
-
Xiang Xu authored
-
- 23 Jan, 2024 1 commit
-
-
Antoni Baum authored
Co-authored-by:
Chen Shen <scv119@gmail.com> Co-authored-by:
Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by:
-
- 03 Jan, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 18 Dec, 2023 1 commit
-
-
kliuae authored
-
- 17 Dec, 2023 3 commits
-
-
Woosuk Kwon authored
-
Woosuk Kwon authored
-
Woosuk Kwon authored
Co-authored-by:
Antoni Baum <antoni.baum@protonmail.com>
-
- 16 Dec, 2023 2 commits
-
-
Roy authored
-
Woosuk Kwon authored
-
- 15 Dec, 2023 1 commit
-
-
CHU Tianxiang authored
-
- 14 Dec, 2023 1 commit
-
-
Antoni Baum authored
-
- 11 Dec, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 08 Dec, 2023 1 commit
-
-
TJian authored
Co-authored-by:
Philipp Moritz <pcmoritz@gmail.com> Co-authored-by:
Amir Balwel <amoooori04@gmail.com> Co-authored-by:
root <kuanfu.liu@akirakan.com> Co-authored-by:
tjtanaa <tunjian.tan@embeddedllm.com> Co-authored-by:
kuanfu <kuanfu.liu@embeddedllm.com> Co-authored-by:
miloice <17350011+kliuae@users.noreply.github.com>
-
- 30 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 21 Nov, 2023 1 commit
-
-
boydfd authored
Co-authored-by:ran_lin <rlin@thoughtworks.com>
-
- 19 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 18 Nov, 2023 2 commits
-
-
liuyhwangyh authored
-
Woosuk Kwon authored
-
- 16 Nov, 2023 2 commits
-
-
Aaron Pham authored
Signed-off-by:Aaron <29749331+aarnphm@users.noreply.github.com>
-
Zhuohan Li authored
TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622) Refactor the tensor parallelism, quantization, and weight-loading codes. Summary of the new features enabled by this PR: - **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580). - Model loading code became much simpler. - Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
-
