- 31 Jan, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 23 Jan, 2024 1 commit
-
-
Antoni Baum authored
Co-authored-by:
Chen Shen <scv119@gmail.com> Co-authored-by:
Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by:
Avnish Narayan <avnish@anyscale.com>
-
- 13 Dec, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 11 Dec, 2023 1 commit
-
-
Pierre Stock authored
Co-authored-by:
Pierre Stock <p@mistral.ai> Co-authored-by:
Zhuohan Li <zhuohan123@gmail.com>
-
- 08 Dec, 2023 1 commit
-
-
TJian authored
Co-authored-by:
Philipp Moritz <pcmoritz@gmail.com> Co-authored-by:
Amir Balwel <amoooori04@gmail.com> Co-authored-by:
root <kuanfu.liu@akirakan.com> Co-authored-by:
tjtanaa <tunjian.tan@embeddedllm.com> Co-authored-by:
kuanfu <kuanfu.liu@embeddedllm.com> Co-authored-by:
miloice <17350011+kliuae@users.noreply.github.com>
-
- 05 Dec, 2023 1 commit
-
-
dancingpipi authored
Co-authored-by:shujunhua1 <shujunhua1@jd.com>
-
- 27 Nov, 2023 1 commit
-
-
ljss authored
-
- 20 Nov, 2023 1 commit
-
-
Simon Mo authored
-
- 18 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 16 Nov, 2023 3 commits
-
-
maximzubkov authored
-
Megha Agarwal authored
-
Zhuohan Li authored
TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622) Refactor the tensor parallelism, quantization, and weight-loading codes. Summary of the new features enabled by this PR: - **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580). - Model loading code became much simpler. - Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
-
- 09 Nov, 2023 1 commit
-
-
forpanyang authored
-
- 07 Nov, 2023 1 commit
-
-
GoHomeToMacDonal authored
-
- 06 Nov, 2023 1 commit
-
-
Roy authored
-
- 01 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 31 Oct, 2023 1 commit
-
-
Wenfei Yan authored
-
- 13 Oct, 2023 1 commit
-
-
Lu Wang authored
-
- 11 Oct, 2023 1 commit
-
-
amaleshvemula authored
-
- 28 Sep, 2023 1 commit
-
-
Chris Bamford authored
Co-authored-by:timlacroix <t@mistral.ai>
-
- 18 Sep, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 16 Sep, 2023 1 commit
-
-
Woosuk Kwon authored
Co-authored-by:
Robert Irvine <robert@seamlessml.com> Co-authored-by:
root <rirv938@gmail.com> Co-authored-by:
Casper <casperbh.96@gmail.com> Co-authored-by:
julian-q <julianhquevedo@gmail.com>
-
- 13 Sep, 2023 1 commit
-
-
Jasmond L authored
Co-authored-by:
Jasmond Loh <Jasmond.Loh@hotmail.com> Co-authored-by:
-
- 07 Sep, 2023 2 commits
-
-
Zhuohan Li authored
-
Antoni Baum authored
Signed-off-by:Antoni Baum <antoni.baum@protonmail.com>
-
- 22 Aug, 2023 1 commit
-
-
shunxing1234 authored
* add aquila Signed-off-by:
ftgreat <ftgreat@163.com> * fix some bug Signed-off-by:
shunxing1234 <xw747777271@gmail.com> * delete pdb Signed-off-by:
-
- 08 Aug, 2023 2 commits
-
-
Jia Guoqing authored
-
Qing authored
Co-authored-by:wq.chu <wq.chu@tianrang-inc.com>
-
- 02 Aug, 2023 2 commits
-
-
Zhuohan Li authored
-
Song authored
-
- 17 Jul, 2023 1 commit
-
-
codethazine authored
-
- 09 Jul, 2023 1 commit
-
-
Andre Slavescu authored
Co-authored-by:woWoosuk Kwon <woosuk.kwon@berkeley.edu>
-
- 03 Jul, 2023 3 commits
-
-
Woosuk Kwon authored
-
Woosuk Kwon authored
-
Zhuohan Li authored
-
- 26 Jun, 2023 1 commit
-
-
BasicCoder authored
-
- 22 Jun, 2023 1 commit
-
-
Michael Feil authored
-
- 17 Jun, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 24 May, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 20 May, 2023 1 commit
-
-
Woosuk Kwon authored
-
