Commits · 002800f08142574aeafed7c33982503d28d53cdc · kecinstone / 2024pra-vllm

05 Sep, 2023 1 commit
- Align vLLM's beam search implementation with HF generate (#857) · 002800f0
  Zhuohan Li authored Sep 04, 2023
  
  002800f0
30 Aug, 2023 1 commit
- Accelerate LLaMA model loading (#234) · 0d93f156
  JFDuan authored Aug 30, 2023
  
  0d93f156
25 Aug, 2023 1 commit
- Add support for CodeLlama (#854) · 4b6f069b
  Antoni Baum authored Aug 25, 2023
  
  4b6f069b
22 Aug, 2023 3 commits

fix: revert code to avoid no attribute problem (#827) · eedac9db
Wen Sun authored Aug 23, 2023

eedac9db

Add support for aquila (#663) · ad5f2fe3

shunxing1234 authored Aug 22, 2023



* add aquila
Signed-off-by: ftgreat <ftgreat@163.com>

* fix some bug
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete pdb
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete whitespace
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* format

* fix order

---------
Signed-off-by: ftgreat <ftgreat@163.com>
Signed-off-by: shunxing1234 <xw747777271@gmail.com>
Co-authored-by: ftgreat <ftgreat@163.com>

ad5f2fe3

Fix mqa is false case in gpt_bigcode (#806) · 4f858475
zhaoyang-star authored Aug 22, 2023

4f858475

11 Aug, 2023 1 commit
- [Fix] unwantted bias in InternLM Model (#740) · 462ae522
  WRH authored Aug 12, 2023
  
  462ae522
08 Aug, 2023 2 commits
- add internlm model (#528) · 735ecfff
  Jia Guoqing authored Aug 09, 2023
  
  735ecfff
- add QWen-7b (#685) · a57d13cc
  Qing authored Aug 09, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
  a57d13cc
02 Aug, 2023 3 commits
- [Doc] Add Baichuan 13B to supported models (#656) · f7389f47
  Zhuohan Li authored Aug 02, 2023
  
  f7389f47
- Add Falcon support (new) (#592) · 1b0bd0fe
  Zhuohan Li authored Aug 02, 2023
  
  1b0bd0fe
- fix baichuan for different position embedding for 7b and 13b models (#643) · 64f23c29
  Song authored Aug 02, 2023
  
  64f23c29
01 Aug, 2023 1 commit
- fix biachuan-7b tp (#598) · d4c7755c
  Qing authored Aug 02, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
  d4c7755c
25 Jul, 2023 1 commit
- [Fix] Fix GPTBigcoder for distributed execution (#503) · 7d5a155e
  Zhuohan Li authored Jul 24, 2023
  
  7d5a155e
24 Jul, 2023 1 commit
- GPTJConfig has no attribute rotary. (#532) · 1dde34e0
  leegohi04517 authored Jul 25, 2023
  
  1dde34e0
20 Jul, 2023 1 commit
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
17 Jul, 2023 1 commit
- Add support for baichuan (#365) · 20b0d88d
  codethazine authored Jul 17, 2023
  
  20b0d88d
15 Jul, 2023 1 commit
- Optimize MQA Kernel (#452) · 96853af5
  Zhuohan Li authored Jul 14, 2023
  
  96853af5
14 Jul, 2023 2 commits
- Fix the `KeyError` when loading bloom-based models (#441) · dbed6905
  Wen Sun authored Jul 14, 2023
  
  dbed6905
- add vocab padding for LLama(Support WizardLM) (#411) · 7b6ae940
  panda authored Jul 14, 2023
  
  7b6ae940
09 Jul, 2023 1 commit
- [Model] Add support for GPT-J (#226) · c8948361
  Andre Slavescu authored Jul 08, 2023
```
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8948361
03 Jul, 2023 4 commits
- [Model] Add support for MPT (#334) · 404422f4
  Woosuk Kwon authored Jul 03, 2023
  
  404422f4
- [Quality] Add CI for formatting (#343) · 42e0c1df
  Zhuohan Li authored Jul 03, 2023
  
  42e0c1df
- Add support for BLOOM (#331) · e41f0670
  Woosuk Kwon authored Jul 03, 2023
  
  e41f0670
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
30 Jun, 2023 1 commit
- [Fix] Weight loading for GPTBigCode (#313) · 598dc4b7
  Zhuohan Li authored Jun 29, 2023
  
  598dc4b7
27 Jun, 2023 1 commit
- expand coverage of gpt2 model loading (#271) · 4026a049
  twaka authored Jun 27, 2023
  
  4026a049
22 Jun, 2023 1 commit
- GPTBigCode (StarCoder, SantaCoder Support) (#209) · 298695b7
  Michael Feil authored Jun 22, 2023
  
  298695b7
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15