Commits · ad5f2fe34cf2b3564a2d71500a7a096e25065734 · kecinstone / 2024pra-vllm

22 Aug, 2023 2 commits

Add support for aquila (#663) · ad5f2fe3

shunxing1234 authored Aug 22, 2023



* add aquila
Signed-off-by: ftgreat <ftgreat@163.com>

* fix some bug
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete pdb
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete whitespace
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* format

* fix order

---------
Signed-off-by: ftgreat <ftgreat@163.com>
Signed-off-by: shunxing1234 <xw747777271@gmail.com>
Co-authored-by: ftgreat <ftgreat@163.com>

ad5f2fe3

Fix mqa is false case in gpt_bigcode (#806) · 4f858475
zhaoyang-star authored Aug 22, 2023

4f858475

18 Aug, 2023 1 commit
- Fix typo in sampling_params.py (#788) · 0c04ce32
  wangcx18 authored Aug 18, 2023
  
  0c04ce32
17 Aug, 2023 1 commit
- explicitly del state (#784) · 73b3de79
  Xinyu Yang authored Aug 18, 2023
  
  73b3de79
15 Aug, 2023 2 commits
- Align with huggingface Top K sampling (#753) · d1744376
  Abraham-Xu authored Aug 16, 2023
  
  d1744376
- Fix typo in tokenizer.py (#750) · 805de738
  Ikko Eltociear Ashimine authored Aug 15, 2023
```
conjuction -> conjunction
```
  805de738
11 Aug, 2023 2 commits
- Supports tokens and arrays of tokens as inputs to the OpenAI completion API (#715) · e06f504a
  WanMok authored Aug 11, 2023
  
  e06f504a
- [Fix] unwantted bias in InternLM Model (#740) · 462ae522
  WRH authored Aug 12, 2023
  
  462ae522
09 Aug, 2023 1 commit
- Check the max prompt length for the OpenAI completions API (#472) · 66c54aa9
  Nicolas Basile authored Aug 08, 2023
  
  66c54aa9
08 Aug, 2023 2 commits
- add internlm model (#528) · 735ecfff
  Jia Guoqing authored Aug 09, 2023
  
  735ecfff
- add QWen-7b (#685) · a57d13cc
  Qing authored Aug 09, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
  a57d13cc
04 Aug, 2023 1 commit
- fix: incorrect bigcode attention heads num (#676) · 621980bd
  Wen Sun authored Aug 05, 2023
  
  621980bd
02 Aug, 2023 7 commits
- Bump up version to 0.1.3 (#657) · aa84c92e
  Zhuohan Li authored Aug 02, 2023
  
  aa84c92e
- [Doc] Add Baichuan 13B to supported models (#656) · f7389f47
  Zhuohan Li authored Aug 02, 2023
  
  f7389f47
- Refactor scheduler (#658) · 55fe8a81
  Woosuk Kwon authored Aug 02, 2023
  
  55fe8a81
- [BUG FIX] upgrade fschat version to 0.2.23 (#650) · e8ddc08e
  YHPeter authored Aug 02, 2023
```
Co-authored-by: hao.yu <hao.yu@cn-c017.server.mila.quebec>
```
  e8ddc08e
- Add Falcon support (new) (#592) · 1b0bd0fe
  Zhuohan Li authored Aug 02, 2023
  
  1b0bd0fe
- Fix log message in scheduler (#652) · 20044cab
  Lily Liu authored Aug 02, 2023
  
  20044cab
- fix baichuan for different position embedding for 7b and 13b models (#643) · 64f23c29
  Song authored Aug 02, 2023
  
  64f23c29
01 Aug, 2023 1 commit
- fix biachuan-7b tp (#598) · d4c7755c
  Qing authored Aug 02, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
  d4c7755c
31 Jul, 2023 1 commit
- fix doc (#622) · aa39e42c
  Chaofan Lin authored Aug 01, 2023
  
  aa39e42c
30 Jul, 2023 1 commit
- fix ModuleNotFoundError (#599) · 953f28cf
  Fang li authored Jul 30, 2023
```
Co-authored-by: fangli <fangli@tencent.com>
```
  953f28cf
28 Jul, 2023 1 commit
- [Fix] fix import error of RayWorker (#604) (#605) · c0d00f5b
  Xudong Zhang authored Jul 28, 2023
  
  c0d00f5b
26 Jul, 2023 2 commits
- [Fix] Add model sequence length into model config (#575) · 58a072be
  Zhuohan Li authored Jul 25, 2023
  
  58a072be
- [Fix] Add chat completion Example and simplify dependencies (#576) · 82ad323d
  Zhuohan Li authored Jul 25, 2023
  
  82ad323d
25 Jul, 2023 2 commits
- fixed tensor parallel is not defined (#564) · 2d867b55
  MoeedDar authored Jul 25, 2023
  
  2d867b55
- [Fix] Fix GPTBigcoder for distributed execution (#503) · 7d5a155e
  Zhuohan Li authored Jul 24, 2023
  
  7d5a155e
24 Jul, 2023 1 commit
- GPTJConfig has no attribute rotary. (#532) · 1dde34e0
  leegohi04517 authored Jul 25, 2023
  
  1dde34e0
20 Jul, 2023 5 commits
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
- Fix bad assert in initialize_cluster if PG already exists (#526) · c487a221
  Antoni Baum authored Jul 19, 2023
  
  c487a221
- Ray placement group support (#397) · 9925c179
  Antoni Baum authored Jul 19, 2023
  
  9925c179
- fix: enable trust-remote-code in api server & benchmark. (#509) · 8c4b2592
  Ricardo Lu authored Jul 20, 2023
  
  8c4b2592
- fix(ray_utils): ignore re-init error (#465) · 16c3e295
  Massimiliano Pronesti authored Jul 20, 2023
  
  16c3e295
18 Jul, 2023 3 commits
- hotfix attn alibi wo head mapping (#496) · bda41c70
  Song authored Jul 19, 2023
```
Co-authored-by: oliveryuan <oliveryuan@basemind.com>
```
  bda41c70
- Fixed old name reference for max_seq_len · 328d231c
  MoeedDar authored Jul 18, 2023
  
  328d231c
- fix max seq len (#489) · b4b195b3
  Lily Liu authored Jul 17, 2023
  
  b4b195b3
17 Jul, 2023 2 commits
- Add support for baichuan (#365) · 20b0d88d
  codethazine authored Jul 17, 2023
  
  20b0d88d
- [Fix] Fix the condition of max_seq_len (#477) · 2bdea7ac
  Zhuohan Li authored Jul 17, 2023
  
  2bdea7ac
16 Jul, 2023 1 commit
- Offload port selection to OS (#467) · 6d7d95a7
  Zhangir Azerbayev authored Jul 16, 2023
  
  6d7d95a7
15 Jul, 2023 1 commit
- Optimize MQA Kernel (#452) · 96853af5
  Zhuohan Li authored Jul 14, 2023
  
  96853af5