Commits · 3b7178cfa4a317922d4aef9dd3b2647b8d950e7d · kecinstone / 2024pra-vllm

28 Feb, 2024 1 commit
- [Neuron] Support inference with transformers-neuronx (#2569) · 3b7178cf
  Liangfu Chen authored Feb 28, 2024
  
  3b7178cf
27 Feb, 2024 2 commits
- Support Orion model (#2539) · 48a8f4a7
  张大成 authored Feb 27, 2024
```
Co-authored-by: zhangdacheng <zhangdacheng@ainirobot.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  48a8f4a7
- Fix stablelm (#3038) · 4dd6416f
  Roy authored Feb 27, 2024
  
  4dd6416f
22 Feb, 2024 1 commit
- Migrate MistralForCausalLM to LlamaForCausalLM (#2868) · 344020c9
  Roy authored Feb 22, 2024
  
  344020c9
21 Feb, 2024 1 commit
- Add Gemma model (#2964) · 5253edaa
  Xiang Xu authored Feb 21, 2024
  
  5253edaa
19 Feb, 2024 1 commit
- Support OLMo models. (#2832) · ab3a5a82
  Isotr0py authored Feb 19, 2024
  
  ab3a5a82
14 Feb, 2024 2 commits
- Migrate AquilaForCausalLM to LlamaForCausalLM (#2867) · 4efbac6d
  Roy authored Feb 15, 2024
  
  4efbac6d
- Migrate InternLMForCausalLM to LlamaForCausalLM (#2860) · 7eacffd9
  Philipp Moritz authored Feb 13, 2024
```
Co-authored-by: Roy <jasonailu87@gmail.com>
```
  7eacffd9
13 Feb, 2024 2 commits
- Revert "Refactor llama family models (#2637)" (#2851) · ea356004
  Philipp Moritz authored Feb 13, 2024
```
This reverts commit 5c976a7e.
```
  ea356004
- Refactor llama family models (#2637) · 5c976a7e
  Roy authored Feb 13, 2024
  
  5c976a7e
01 Feb, 2024 1 commit
- Add Internlm2 (#2666) · cd9e60c7
  Fengzhe Zhou authored Feb 02, 2024
  
  cd9e60c7
31 Jan, 2024 1 commit
- Add quantized mixtral support (#2673) · 3dad9444
  Woosuk Kwon authored Jan 30, 2024
  
  3dad9444
30 Jan, 2024 1 commit
- DeepseekMoE support with Fused MoE kernel (#2453) · 5d60def0
  wangding zeng authored Jan 30, 2024
```
Co-authored-by: roy <jasonailu87@gmail.com>
```
  5d60def0
22 Jan, 2024 1 commit
- Add qwen2 (#2495) · 94b5edeb
  Junyang Lin authored Jan 23, 2024
  
  94b5edeb
17 Jan, 2024 1 commit
- Add StableLM3B model (#2372) · e1957c6e
  Hyunsung Lee authored Jan 17, 2024
  
  e1957c6e
12 Jan, 2024 1 commit
- Address Phi modeling update 2 (#2428) · 7878958c
  Gary Hui authored Jan 13, 2024
  
  7878958c
19 Dec, 2023 1 commit
- Added DeciLM-7b and DeciLM-7b-instruct (#2062) · de60a3fb
  avideci authored Dec 19, 2023
  
  de60a3fb
14 Dec, 2023 1 commit
- Optimize Mixtral with expert parallelism (#2090) · 21d93c14
  Antoni Baum authored Dec 13, 2023
  
  21d93c14
13 Dec, 2023 1 commit
- Implement lazy model loader (#2044) · 518369d7
  Woosuk Kwon authored Dec 12, 2023
  
  518369d7
11 Dec, 2023 1 commit

Mixtral 8x7B support (#2011) · b5f882cc

Pierre Stock authored Dec 11, 2023


Co-authored-by: Pierre Stock <p@mistral.ai>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

b5f882cc

16 Nov, 2023 2 commits
- Support Microsoft Phi 1.5 (#1664) · 521b35f7
  maximzubkov authored Nov 16, 2023
  
  521b35f7
- Revert `MptConfig` to `MPTConfig` (#1668) · b514d3c4
  Megha Agarwal authored Nov 16, 2023
  
  b514d3c4
07 Nov, 2023 1 commit
- ChatGLM Support (#1261) · 1a2bbc93
  GoHomeToMacDonal authored Nov 07, 2023
  
  1a2bbc93
06 Nov, 2023 1 commit
- Support Yi model (#1567) · e7f579eb
  Roy authored Nov 07, 2023
  
  e7f579eb
01 Nov, 2023 1 commit
- Remove `MPTConfig` (#1529) · 1fe09900
  Woosuk Kwon authored Nov 01, 2023
  
  1fe09900
13 Oct, 2023 1 commit
- Bump up transformers version & Remove MistralConfig (#1254) · e7c8555d
  Woosuk Kwon authored Oct 13, 2023
  
  e7c8555d
28 Sep, 2023 1 commit
- [Mistral] Mistral-7B-v0.1 support (#1196) · bb1ba58f
  Chris Bamford authored Sep 28, 2023
```
Co-authored-by: timlacroix <t@mistral.ai>
```
  bb1ba58f
22 Aug, 2023 1 commit

Add support for aquila (#663) · ad5f2fe3

shunxing1234 authored Aug 22, 2023



* add aquila
Signed-off-by: ftgreat <ftgreat@163.com>

* fix some bug
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete pdb
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete whitespace
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* format

* fix order

---------
Signed-off-by: ftgreat <ftgreat@163.com>
Signed-off-by: shunxing1234 <xw747777271@gmail.com>
Co-authored-by: ftgreat <ftgreat@163.com>

ad5f2fe3

08 Aug, 2023 2 commits
- add internlm model (#528) · 735ecfff
  Jia Guoqing authored Aug 09, 2023
  
  735ecfff
- add QWen-7b (#685) · a57d13cc
  Qing authored Aug 09, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
  a57d13cc
02 Aug, 2023 3 commits
- [Doc] Add Baichuan 13B to supported models (#656) · f7389f47
  Zhuohan Li authored Aug 02, 2023
  
  f7389f47
- Add Falcon support (new) (#592) · 1b0bd0fe
  Zhuohan Li authored Aug 02, 2023
  
  1b0bd0fe
- fix baichuan for different position embedding for 7b and 13b models (#643) · 64f23c29
  Song authored Aug 02, 2023
  
  64f23c29
17 Jul, 2023 1 commit
- Add support for baichuan (#365) · 20b0d88d
  codethazine authored Jul 17, 2023
  
  20b0d88d
09 Jul, 2023 1 commit
- [Model] Add support for GPT-J (#226) · c8948361
  Andre Slavescu authored Jul 08, 2023
```
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8948361
03 Jul, 2023 3 commits
- [Model] Add support for MPT (#334) · 404422f4
  Woosuk Kwon authored Jul 03, 2023
  
  404422f4
- Add support for BLOOM (#331) · e41f0670
  Woosuk Kwon authored Jul 03, 2023
  
  e41f0670
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
22 Jun, 2023 1 commit
- GPTBigCode (StarCoder, SantaCoder Support) (#209) · 298695b7
  Michael Feil authored Jun 22, 2023
  
  298695b7
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15