Commits · ce741ba3e4fea00bacd2e1c609ca587ec35eb161 · norm / vllm

04 Sep, 2023 2 commits
- Refactor AsyncLLMEngine (#880) · ce741ba3
  Antoni Baum authored Sep 03, 2023
  
  ce741ba3
- [BugFix] Fix NaN errors in paged attention kernel (#936) · bf87484e
  Woosuk Kwon authored Sep 04, 2023
  
  bf87484e
02 Sep, 2023 1 commit
- Avoid compiling kernels for double data type (#933) · 8ce9c50d
  Woosuk Kwon authored Sep 02, 2023
  
  8ce9c50d
01 Sep, 2023 2 commits
- Add tests for models (#922) · 32b6816e
  Woosuk Kwon authored Sep 01, 2023
  
  32b6816e
- Fix README.md Link (#927) · c128d698
  Zhuohan Li authored Aug 31, 2023
  
  c128d698
31 Aug, 2023 3 commits
- [Docs] Minor fixes in supported models (#920) · 55b28b1e
  Woosuk Kwon authored Sep 01, 2023
```
* Minor fix in supported models

* Add another small fix for Aquila model

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  55b28b1e
- fix: bug fix when penalties are negative (#913) · e1122233
  Dong-Yong Lee authored Sep 01, 2023
```
Co-authored-by: dongyong-lee <dongyong.lee@navercorp.com>
```
  e1122233
- Improve _prune_hidden_states micro-benchmark (#707) · 28873a27
  Aman Gupta Karmani authored Aug 31, 2023
  
  28873a27
30 Aug, 2023 4 commits
- Add acknowledgement to a16z grant · 0080d832
  Zhuohan Li authored Aug 30, 2023
  
  0080d832
- Accelerate LLaMA model loading (#234) · 0d93f156
  JFDuan authored Aug 30, 2023
  
  0d93f156
- Enable request body OpenAPI spec for OpenAI endpoints (#865) · becd7a56
  lplcor authored Aug 29, 2023
  
  becd7a56
- use flash-attn via xformers (#877) · 75471386
  Aman Gupta Karmani authored Aug 30, 2023
  
  75471386
28 Aug, 2023 1 commit
- [Fix] Fix a condition for ignored sequences (#867) · d2b2eed6
  Zhuohan Li authored Aug 27, 2023
  
  d2b2eed6
25 Aug, 2023 3 commits
- Add support for CodeLlama (#854) · 4b6f069b
  Antoni Baum authored Aug 25, 2023
  
  4b6f069b
- Bump up the version to v0.1.4 (#846) · 791d79de
  Woosuk Kwon authored Aug 25, 2023
  
  791d79de
- Set replacement=True in torch.multinomial (#858) · 94d2f598
  Woosuk Kwon authored Aug 25, 2023
  
  94d2f598
23 Aug, 2023 3 commits
- Clean up code (#844) · 75c0ca9d
  wenjun93 authored Aug 24, 2023
  
  75c0ca9d
- Fix for breaking changes in xformers 0.0.21 (#834) · 2a4ec908
  Woosuk Kwon authored Aug 23, 2023
  
  2a4ec908
- Fix typo of Aquila in README.md (#836) · 85ebcda9
  ldwang authored Aug 23, 2023
  
  85ebcda9
22 Aug, 2023 6 commits

Implement approximate GELU kernels (#828) · d64bf164
Woosuk Kwon authored Aug 23, 2023

d64bf164
Add compute capability 8.9 to default targets (#829) · a41c2043
Woosuk Kwon authored Aug 23, 2023

a41c2043
fix: revert code to avoid no attribute problem (#827) · eedac9db
Wen Sun authored Aug 23, 2023

eedac9db
Update Supported Model List (#825) · 14f9c72b
Zhuohan Li authored Aug 22, 2023

14f9c72b

Add support for aquila (#663) · ad5f2fe3

shunxing1234 authored Aug 22, 2023



* add aquila
Signed-off-by: ftgreat <ftgreat@163.com>

* fix some bug
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete pdb
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* fix bugs
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* delete whitespace
Signed-off-by: shunxing1234 <xw747777271@gmail.com>

* format

* fix order

---------
Signed-off-by: ftgreat <ftgreat@163.com>
Signed-off-by: shunxing1234 <xw747777271@gmail.com>
Co-authored-by: ftgreat <ftgreat@163.com>

ad5f2fe3

Fix mqa is false case in gpt_bigcode (#806) · 4f858475
zhaoyang-star authored Aug 22, 2023

4f858475

21 Aug, 2023 2 commits
- set default coompute capability according to cuda version (#773) · 65fc1c31
  Xudong Zhang authored Aug 22, 2023
  
  65fc1c31
- [Feature | CI] Added a github action to build wheels (#746) · c393af6c
  Daniel authored Aug 21, 2023
  
  c393af6c
18 Aug, 2023 1 commit
- Fix typo in sampling_params.py (#788) · 0c04ce32
  wangcx18 authored Aug 18, 2023
  
  0c04ce32
17 Aug, 2023 1 commit
- explicitly del state (#784) · 73b3de79
  Xinyu Yang authored Aug 18, 2023
  
  73b3de79
15 Aug, 2023 2 commits
- Align with huggingface Top K sampling (#753) · d1744376
  Abraham-Xu authored Aug 16, 2023
  
  d1744376
- Fix typo in tokenizer.py (#750) · 805de738
  Ikko Eltociear Ashimine authored Aug 15, 2023
```
conjuction -> conjunction
```
  805de738
14 Aug, 2023 1 commit
- Fix baichuan doc style (#748) · 1b151ed1
  Uranus authored Aug 14, 2023
  
  1b151ed1
11 Aug, 2023 2 commits
- Supports tokens and arrays of tokens as inputs to the OpenAI completion API (#715) · e06f504a
  WanMok authored Aug 11, 2023
  
  e06f504a
- [Fix] unwantted bias in InternLM Model (#740) · 462ae522
  WRH authored Aug 12, 2023
  
  462ae522
09 Aug, 2023 1 commit
- Check the max prompt length for the OpenAI completions API (#472) · 66c54aa9
  Nicolas Basile authored Aug 08, 2023
  
  66c54aa9
08 Aug, 2023 2 commits
- add internlm model (#528) · 735ecfff
  Jia Guoqing authored Aug 09, 2023
  
  735ecfff
- add QWen-7b (#685) · a57d13cc
  Qing authored Aug 09, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
  a57d13cc
04 Aug, 2023 2 commits
- [OPTIMIZATION] Optimizes the single_query_cached_kv_attention kernel (#420) · 79af7e96
  Dean Leitersdorf authored Aug 04, 2023
  
  79af7e96
- fix: incorrect bigcode attention heads num (#676) · 621980bd
  Wen Sun authored Aug 05, 2023
  
  621980bd
02 Aug, 2023 1 commit
- Bump up version to 0.1.3 (#657) · aa84c92e
  Zhuohan Li authored Aug 02, 2023
  
  aa84c92e