Commits · 03d37f24413b13a4e42ee115f89f647c441d1fcd · OpenDAS / vllm_cscc

11 Mar, 2024 1 commit
- Re-enable the 80 char line width limit (#3305) · 2f8844ba
  Zhuohan Li authored Mar 10, 2024
  
  2f8844ba
05 Mar, 2024 1 commit
- Store `eos_token_id` in `Sequence` for easy access (#3166) · 8999ec3c
  Nick Hill authored Mar 05, 2024
  
  8999ec3c
02 Mar, 2024 1 commit

Add Automatic Prefix Caching (#2762) · ce4f5a29

Sage Moore authored Mar 02, 2024


Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

ce4f5a29

22 Feb, 2024 1 commit
- chore(vllm): codespell for spell checking (#2820) · 93dc5a28
  Massimiliano Pronesti authored Feb 22, 2024
  
  93dc5a28
21 Feb, 2024 2 commits
- Support per-request seed (#2514) · 7d2dcce1
  Nick Hill authored Feb 21, 2024
  
  7d2dcce1
- Add metrics to RequestOutput (#2876) · 017d9f15
  Antoni Baum authored Feb 20, 2024
  
  017d9f15
23 Jan, 2024 1 commit

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

21 Jan, 2024 1 commit
- [Fix] Keep `scheduler.running` as deque (#2523) · d75c4073
  Nick Hill authored Jan 20, 2024
  
  d75c4073
18 Jan, 2024 2 commits
- [BugFix] Fix abort_seq_group (#2463) · d2a68364
  ljss authored Jan 19, 2024
  
  d2a68364
- [Experimental] Prefix Caching Support (#1669) · d10f8e1d
  shiyi.c_98 authored Jan 17, 2024
```
Co-authored-by: DouHappy <2278958187@qq.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d10f8e1d
12 Jan, 2024 2 commits
- fix: deque mutated during iteration in abort_seq_group (#2371) · 48cf1e41
  陈序 authored Jan 13, 2024
  
  48cf1e41
- [DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011) · 6549aef2
  Jiaxiang authored Jan 12, 2024
  
  6549aef2
07 Jan, 2024 1 commit
- Changed scheduler to use deques instead of lists (#2290) · 05921a9a
  Nadav Shmayovits authored Jan 07, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  05921a9a
21 Dec, 2023 1 commit
- [BugFix] Fix recovery logic for sequence group (#2186) · a1b9cb2a
  Woosuk Kwon authored Dec 20, 2023
  
  a1b9cb2a
21 Nov, 2023 2 commits
- [Fix] Fix bugs in scheduler (#1727) · 19849db5
  Zhuofan authored Nov 21, 2023
  
  19849db5
- Fix hanging in the scheduler caused by long prompts (#1534) · 3d4ceb29
  陈序 authored Nov 21, 2023
  
  3d4ceb29
20 Nov, 2023 1 commit
- Migrate linter from `pylint` to `ruff` (#1665) · 5ffc0d13
  Simon Mo authored Nov 20, 2023
  
  5ffc0d13
20 Oct, 2023 1 commit
- Fix type hints (#1427) · f61dc807
  Light Lin authored Oct 20, 2023
  
  f61dc807
17 Oct, 2023 1 commit
- Change scheduler & input tensor shape (#1381) · c1376e0f
  Woosuk Kwon authored Oct 16, 2023
  
  c1376e0f
03 Oct, 2023 1 commit
- Use monotonic time where appropriate (#1249) · acbed3ef
  Antoni Baum authored Oct 02, 2023
  
  acbed3ef
28 Sep, 2023 1 commit
- [Mistral] Mistral-7B-v0.1 support (#1196) · bb1ba58f
  Chris Bamford authored Sep 28, 2023
```
Co-authored-by: timlacroix <t@mistral.ai>
```
  bb1ba58f
17 Sep, 2023 1 commit
- Fix hanging when prompt exceeds limit (#1029) · e21d7687
  陈序 authored Sep 17, 2023
  
  e21d7687
07 Sep, 2023 1 commit

Make `AsyncLLMEngine` more robust & fix batched abort (#969) · c07ece5c

Antoni Baum authored Sep 07, 2023


Signed-off-by: Antoni Baum <antoni.baum@protonmail.com>
Co-authored-by: Avnish Narayan <38871737+avnishn@users.noreply.github.com>

c07ece5c

05 Sep, 2023 1 commit
- Align vLLM's beam search implementation with HF generate (#857) · 002800f0
  Zhuohan Li authored Sep 04, 2023
  
  002800f0
04 Sep, 2023 1 commit
- Refactor AsyncLLMEngine (#880) · ce741ba3
  Antoni Baum authored Sep 03, 2023
  
  ce741ba3
28 Aug, 2023 1 commit
- [Fix] Fix a condition for ignored sequences (#867) · d2b2eed6
  Zhuohan Li authored Aug 27, 2023
  
  d2b2eed6
23 Aug, 2023 1 commit
- Clean up code (#844) · 75c0ca9d
  wenjun93 authored Aug 24, 2023
  
  75c0ca9d
02 Aug, 2023 2 commits
- Refactor scheduler (#658) · 55fe8a81
  Woosuk Kwon authored Aug 02, 2023
  
  55fe8a81
- Fix log message in scheduler (#652) · 20044cab
  Lily Liu authored Aug 02, 2023
  
  20044cab
18 Jul, 2023 2 commits
- Fixed old name reference for max_seq_len · 328d231c
  MoeedDar authored Jul 18, 2023
  
  328d231c
- fix max seq len (#489) · b4b195b3
  Lily Liu authored Jul 17, 2023
  
  b4b195b3
17 Jul, 2023 1 commit
- [Fix] Fix the condition of max_seq_len (#477) · 2bdea7ac
  Zhuohan Li authored Jul 17, 2023
  
  2bdea7ac
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
01 Jul, 2023 1 commit
- Raise error for long prompt (#273) · dafd924c
  Lily Liu authored Jun 30, 2023
  
  dafd924c
26 Jun, 2023 1 commit
- [BugFix] Fix a bug in counting running sequences (#266) · 526df28f
  Woosuk Kwon authored Jun 26, 2023
  
  526df28f
18 Jun, 2023 1 commit
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
17 Jun, 2023 2 commits
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
28 May, 2023 1 commit
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4