"vllm/model_executor/models/opt.py" did not exist on "de0fabbc5c84e6771d70b92014ae06fe82654ff0"
- 13 May, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 26 Apr, 2024 1 commit
-
-
Cody Yu authored
-
- 16 Apr, 2024 1 commit
-
-
Antoni Baum authored
-
- 10 Apr, 2024 1 commit
-
-
youkaichao authored
[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)
-
- 28 Mar, 2024 1 commit
-
-
hxer7963 authored
Co-authored-by:
willhe <hexin@xverse.cn> Co-authored-by:
root <root@localhost.localdomain>
-
- 25 Mar, 2024 3 commits
-
-
xwjiang2010 authored
-
SangBin Cho authored
-
Woosuk Kwon authored
-
- 20 Mar, 2024 1 commit
-
-
Roy authored
-
- 07 Mar, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 28 Feb, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 22 Feb, 2024 1 commit
-
-
Roy authored
-
- 14 Feb, 2024 2 commits
-
-
-
Philipp Moritz authored
Co-authored-by:Roy <jasonailu87@gmail.com>
-
- 13 Feb, 2024 3 commits
-
-
Terry authored
* add mixtral lora support * formatting * fix incorrectly ported logic * polish tests * minor fixes and refactoring * minor fixes * formatting * rename and remove redundant logic * refactoring * refactoring * minor fix * minor refactoring * fix code smell
-
Philipp Moritz authored
This reverts commit 5c976a7e.
-
Roy authored
-
- 23 Jan, 2024 1 commit
-
-
Antoni Baum authored
Co-authored-by:
Chen Shen <scv119@gmail.com> Co-authored-by:
Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by:
Avnish Narayan <avnish@anyscale.com>
-
- 03 Jan, 2024 1 commit
-
-
Zhuohan Li authored
-
- 17 Dec, 2023 1 commit
-
-
Woosuk Kwon authored
Co-authored-by:
Antoni Baum <antoni.baum@protonmail.com>
-
- 15 Dec, 2023 1 commit
-
-
CHU Tianxiang authored
-
- 10 Dec, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 09 Dec, 2023 1 commit
-
-
Jun Gao authored
-
- 30 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 29 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 24 Nov, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 20 Nov, 2023 1 commit
-
-
Simon Mo authored
-
- 19 Nov, 2023 1 commit
-
-
ljss authored
-
- 16 Nov, 2023 1 commit
-
-
Zhuohan Li authored
TP/quantization/weight loading refactor part 2 - Refactor quantized linear logic and extend quantization support to all models (#1622) Refactor the tensor parallelism, quantization, and weight-loading codes. Summary of the new features enabled by this PR: - **All models** are able to be quantized with AWQ and SqueezeLLM, and [soon GPTQ](https://github.com/vllm-project/vllm/pull/1580). - Model loading code became much simpler. - Support model parallelism for all MQA/GQA models when the number of key/value heads is smaller than the tensor parallel size.
-
- 22 Oct, 2023 1 commit
-
-
chooper1 authored
Co-authored-by:
squeeze-ai-lab <squeezeailab.bair@gmail.com> Co-authored-by:
Woosuk Kwon <woosuk.kwon@berkeley.edu>
-
- 02 Oct, 2023 2 commits
-
-
Zhuohan Li authored
-
Zhuohan Li authored
Co-authored-by:JiCheng <247153481@qq.com>
-
- 27 Sep, 2023 1 commit
-
-
Lily Liu authored
Co-authored-by:
Wing Lian <wing.lian@gmail.com> Co-authored-by:
-
- 20 Sep, 2023 1 commit
-
-
Antoni Baum authored
Co-authored-by:
wnma3mz <wnma3mz@gmail.com>
-
- 18 Sep, 2023 1 commit
-
-
Woosuk Kwon authored
-
- 16 Sep, 2023 1 commit
-
-
Woosuk Kwon authored
Co-authored-by:
Robert Irvine <robert@seamlessml.com> Co-authored-by:
root <rirv938@gmail.com> Co-authored-by:
Casper <casperbh.96@gmail.com> Co-authored-by:
julian-q <julianhquevedo@gmail.com>
-
- 13 Sep, 2023 1 commit
-
-
Jasmond L authored
Co-authored-by:
Jasmond Loh <Jasmond.Loh@hotmail.com> Co-authored-by:
Zhuohan Li <zhuohan123@gmail.com>
-
- 07 Sep, 2023 1 commit
-
-
Zhuohan Li authored
-
- 05 Sep, 2023 1 commit
-
-
Zhuohan Li authored
-
- 30 Aug, 2023 1 commit
-
-
JFDuan authored
-
