Commits · 10152d2194c32f6e312c99ed51fd62b01f55598e · OpenDAS / vllm_cscc

30 Jan, 2026 1 commit
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
28 Jan, 2026 1 commit
- Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb673a0
24 Jan, 2026 1 commit

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

22 Jan, 2026 1 commit
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
20 Jan, 2026 1 commit
- [Core] Cleanup shm based object store on engine shutdown (#32429) · 8be263c3
  Walter Beller-Morales authored Jan 20, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  8be263c3
15 Jan, 2026 1 commit
- [code clean] remove duplicate check (#32376) · 9d7ae3fc
  Ning Xie authored Jan 15, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  9d7ae3fc
13 Jan, 2026 1 commit
- [Perf] Optimize requests abort (#32211) · 2a719e08
  Wentao Ye authored Jan 12, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2a719e08
09 Jan, 2026 1 commit
- [Refactor] Remove numpy split in async scheduling (#32034) · 28ae32a5
  Wentao Ye authored Jan 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  28ae32a5
06 Jan, 2026 1 commit
- make 500: InternalServerError more informative (#20610) · 142c4d17
  Masataro Asai authored Jan 06, 2026
```
Signed-off-by: Masataro Asai <guicho2.71828@gmail.com>
```
  142c4d17
30 Dec, 2025 1 commit
- [Core] Deduplicate generate/encode logic in `AsyncLLM` (#31510) · e54ee3ea
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  e54ee3ea
24 Dec, 2025 1 commit
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
23 Dec, 2025 1 commit

[Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686

Mark McLoughlin authored Dec 23, 2025


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

f7900686

20 Dec, 2025 1 commit
- [Bugfix] Read truncate_prompt_tokens from pooling_params in AsyncLLM.encode() (#31013) · 1501a407
  Jeffrey Wang authored Dec 20, 2025
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  1501a407
13 Dec, 2025 1 commit
- [Refactor] `TokenizerRegistry` only uses lazy imports (#30609) · 39cefbdf
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39cefbdf
10 Dec, 2025 2 commits
- {Deprecation] Remove tokenizer setter (#30400) · e72d65b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e72d65b9
- [Chore] Delay recent deprecations (#30398) · 253305d5
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  253305d5
09 Dec, 2025 1 commit

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
05 Dec, 2025 1 commit

[KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170) · adb31506

Tova Movshovitz authored Dec 05, 2025

Signed-off-by: tovam <tovam@pliops.com>
Signed-off-by: Tova Movshovitz <tovam@pliops.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

adb31506

02 Dec, 2025 2 commits
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
- [Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827) · d0cd7289
  Zhuohan Li authored Dec 01, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  d0cd7289
01 Dec, 2025 1 commit
- Make PyTorch profiler gzip and CUDA time dump configurable (#29568) · 1ab8fc81
  Yifei Zhang authored Dec 01, 2025
```
Signed-off-by: Yifei Zhang <yifei.zhang1992@outlook.com>
```
  1ab8fc81
29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
28 Nov, 2025 1 commit
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
25 Nov, 2025 2 commits
- Scheduled removal of `override_pooler_config` and `disable_log_requests` (#29402) · a1f26768
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a1f26768
- [BugFix] bad_words filtering ineffective when n > 1 (#29313) · 32c40b95
  Avishek Goswami authored Nov 25, 2025
```
Signed-off-by: GOavi101 <1704178@kiit.ac.in>
```
  32c40b95
20 Nov, 2025 2 commits

[RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037) · 371b1d4c

Samit authored Nov 20, 2025


Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: samithuang <285365963@qq.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

371b1d4c

[Feat] Iteration-level profiling for Torch and CUDA profiler (#28987) · fcbcba6c

Benjamin Chislett authored Nov 19, 2025

fcbcba6c

15 Nov, 2025 1 commit
- [RL] [V1] Remove unused device argument from reset_kv_cache (#28766) · dd6ac1c2
  Zhuohan Li authored Nov 14, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  dd6ac1c2
13 Nov, 2025 1 commit

[Perf] Support stream interval for reducing host overhead (#27869) · 5d6ce2b9

elvischenv authored Nov 14, 2025


Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

5d6ce2b9

10 Nov, 2025 1 commit
- [Metrics] Refactor LoRA state tracking (#26801) · 6f7de33b
  Mark McLoughlin authored Nov 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6f7de33b
01 Nov, 2025 1 commit

[V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03

wangxiyuan authored Nov 01, 2025


Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

30a14b03

30 Oct, 2025 1 commit
- [CI] Fix mypy for `vllm/v1/core` and `vllm/v1/engine` (#27108) · c01f6e52
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c01f6e52
29 Oct, 2025 1 commit
- [Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
  Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
  1da3309a
28 Oct, 2025 1 commit
- [Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588) · f58d9b64
  Cyrus Leung authored Oct 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f58d9b64
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

21 Oct, 2025 1 commit
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
18 Oct, 2025 1 commit
- [V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
  Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  83e760c5