Commits · 15f5632365a98fd43ea42e4948a995aa399e99b5 · kecinstone / 2024pra-vllm

30 Oct, 2023 1 commit
- Delay GPU->CPU sync in sampling (#1337) · 15f56323
  Antoni Baum authored Oct 30, 2023
  
  15f56323
29 Oct, 2023 1 commit
- Support repetition_penalty (#1424) · 69be658b
  ljss authored Oct 30, 2023
  
  69be658b
22 Oct, 2023 1 commit

chooper1 authored Oct 22, 2023


Co-authored-by: squeeze-ai-lab <squeezeailab.bair@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

1f24755b

17 Oct, 2023 1 commit
- Change scheduler & input tensor shape (#1381) · c1376e0f
  Woosuk Kwon authored Oct 16, 2023
  
  c1376e0f
16 Oct, 2023 2 commits
- Implement prompt logprobs & Batched topk for computing logprobs (#1328) · 9d9072a0
  Zhuohan Li authored Oct 16, 2023
```
Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>
```
  9d9072a0
- Implement PagedAttention V2 (#1348) · 928de468
  Woosuk Kwon authored Oct 16, 2023
  
  928de468
11 Oct, 2023 1 commit
- change the timing of sorting logits (#1309) · 91fce82c
  yhlskt23 authored Oct 11, 2023
  
  91fce82c
02 Oct, 2023 2 commits
- TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181) · ba0bfd40
  Zhuohan Li authored Oct 02, 2023
  
  ba0bfd40
- [Minor] Fix type annotations (#1238) · 84e4e37d
  Woosuk Kwon authored Oct 02, 2023
  
  84e4e37d
28 Sep, 2023 1 commit
- [Mistral] Mistral-7B-v0.1 support (#1196) · bb1ba58f
  Chris Bamford authored Sep 28, 2023
```
Co-authored-by: timlacroix <t@mistral.ai>
```
  bb1ba58f
27 Sep, 2023 1 commit

Support Longchat and RoPE scaling (#555) · 21877b0d

Lily Liu authored Sep 27, 2023


Co-authored-by: Wing Lian <wing.lian@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

21877b0d

26 Sep, 2023 1 commit
- Add comments on RoPE initialization (#1176) · 03ffd0a0
  Woosuk Kwon authored Sep 26, 2023
  
  03ffd0a0
24 Sep, 2023 1 commit
- [FIX] Simplify sampler logic (#1156) · f1878779
  Zhuohan Li authored Sep 23, 2023
  
  f1878779
23 Sep, 2023 1 commit
- [Sampler] Vectorized sampling (simplified) (#1048) · 947b7941
  Zhuohan Li authored Sep 22, 2023
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  947b7941
16 Sep, 2023 1 commit

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e

13 Sep, 2023 1 commit
- [FIX] Minor bug fixes (#1035) · f04908ca
  Zhuohan Li authored Sep 13, 2023
```
* [FIX] Minor bug fixes

* Address review comments
```
  f04908ca
11 Sep, 2023 1 commit
- Use FP32 in RoPE initialization (#1004) · e67b4f2c
  Woosuk Kwon authored Sep 11, 2023
```
Co-authored-by: One <imone@tuta.io>
```
  e67b4f2c
09 Sep, 2023 1 commit
- Fix wrong dtype in PagedAttentionWithALiBi bias (#996) · a62de9ec
  Antoni Baum authored Sep 09, 2023
```
---------
Signed-off-by: Antoni Baum <antoni.baum@protonmail.com>
```
  a62de9ec
08 Sep, 2023 1 commit
- faster startup of vLLM (#982) · 4b5bcf89
  Robert Irvine authored Sep 08, 2023
```
* update

---------
Co-authored-by: Robert Irvine <robert@seamlessml.com>
```
  4b5bcf89
06 Sep, 2023 1 commit
- [BugFix] Implement RoPE for GPT-J (#941) · 320a622e
  Woosuk Kwon authored Sep 06, 2023
  
  320a622e
05 Sep, 2023 1 commit
- Align vLLM's beam search implementation with HF generate (#857) · 002800f0
  Zhuohan Li authored Sep 04, 2023
  
  002800f0
31 Aug, 2023 2 commits
- fix: bug fix when penalties are negative (#913) · e1122233
  Dong-Yong Lee authored Sep 01, 2023
```
Co-authored-by: dongyong-lee <dongyong.lee@navercorp.com>
```
  e1122233
- Improve _prune_hidden_states micro-benchmark (#707) · 28873a27
  Aman Gupta Karmani authored Aug 31, 2023
  
  28873a27
30 Aug, 2023 1 commit
- use flash-attn via xformers (#877) · 75471386
  Aman Gupta Karmani authored Aug 30, 2023
  
  75471386
25 Aug, 2023 1 commit
- Set replacement=True in torch.multinomial (#858) · 94d2f598
  Woosuk Kwon authored Aug 25, 2023
  
  94d2f598
23 Aug, 2023 1 commit
- Fix for breaking changes in xformers 0.0.21 (#834) · 2a4ec908
  Woosuk Kwon authored Aug 23, 2023
  
  2a4ec908
22 Aug, 2023 1 commit
- Implement approximate GELU kernels (#828) · d64bf164
  Woosuk Kwon authored Aug 23, 2023
  
  d64bf164
15 Aug, 2023 1 commit
- Align with huggingface Top K sampling (#753) · d1744376
  Abraham-Xu authored Aug 16, 2023
  
  d1744376
02 Aug, 2023 2 commits
- Refactor scheduler (#658) · 55fe8a81
  Woosuk Kwon authored Aug 02, 2023
  
  55fe8a81
- Add Falcon support (new) (#592) · 1b0bd0fe
  Zhuohan Li authored Aug 02, 2023
  
  1b0bd0fe
20 Jul, 2023 1 commit
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
18 Jul, 2023 1 commit
- hotfix attn alibi wo head mapping (#496) · bda41c70
  Song authored Jul 19, 2023
```
Co-authored-by: oliveryuan <oliveryuan@basemind.com>
```
  bda41c70
15 Jul, 2023 1 commit
- Optimize MQA Kernel (#452) · 96853af5
  Zhuohan Li authored Jul 14, 2023
  
  96853af5
09 Jul, 2023 1 commit
- [Model] Add support for GPT-J (#226) · c8948361
  Andre Slavescu authored Jul 08, 2023
```
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8948361
03 Jul, 2023 3 commits
- [Model] Add support for MPT (#334) · 404422f4
  Woosuk Kwon authored Jul 03, 2023
  
  404422f4
- Add support for BLOOM (#331) · e41f0670
  Woosuk Kwon authored Jul 03, 2023
  
  e41f0670
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
28 Jun, 2023 1 commit
- remove floats == 0 comparison (#285) · 425040d4
  Lily Liu authored Jun 28, 2023
  
  425040d4
22 Jun, 2023 1 commit
- GPTBigCode (StarCoder, SantaCoder Support) (#209) · 298695b7
  Michael Feil authored Jun 22, 2023
  
  298695b7
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15