Commits · 0dd5dee9b9bc88453f5f3eacfde751e6b9ba4871 · OpenDAS / vllm_cscc

05 Jan, 2026 1 commit
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
23 Dec, 2025 1 commit
- [Misc] Introduce `encode_*_url` utility function (#31208) · bb62dda2
  Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bb62dda2
18 Dec, 2025 1 commit

[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new... · 700a5ad6

Isotr0py authored Dec 19, 2025


[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

700a5ad6

07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
02 Dec, 2025 2 commits
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
01 Nov, 2025 1 commit
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
30 Oct, 2025 1 commit
- [BugFix] Handle unscheduled requests properly when async scheduling (#27756) · 2ce5c5d3
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ce5c5d3
18 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

15 Oct, 2025 1 commit
- [Misc] Remove `isort` and `yapf` ignores (#26888) · f93e3480
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f93e3480
14 Oct, 2025 1 commit
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
07 Oct, 2025 1 commit
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
24 Sep, 2025 1 commit
- [TPU][Bugfix] fix the missing apply_model in tpu worker (#25526) · 190c45a6
  Chengji Yao authored Sep 23, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  190c45a6
22 Sep, 2025 1 commit
- [TPU] Deprecate `xm.mark_step` in favor of ``torch_xla.sync` (#25254) · 4cf71cc8
  Nicolò Lucchesi authored Sep 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  4cf71cc8
17 Sep, 2025 1 commit
- [Core] Use `CpuGpuBuffer` for block table tensors (#24795) · eeb135eb
  Nick Hill authored Sep 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  eeb135eb
14 Sep, 2025 1 commit
- [Hybrid Allocator] Support Pipeline Parallel (#23974) · 8e5cdcda
  Chen Zhang authored Sep 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8e5cdcda
12 Sep, 2025 2 commits
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- [Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548) · 0377802c
  Flora Feng authored Sep 12, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0377802c
07 Sep, 2025 1 commit
- [TPU] Remove TopKTopPSampler dependency for TPU sampler (#24391) · 105d3d62
  Woosuk Kwon authored Sep 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  105d3d62
03 Sep, 2025 1 commit

[CI/Build] Serve images used by multimodal tests through local HTTP Server (#23907) · 70549c12

dsinghvi authored Sep 03, 2025


Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

70549c12

25 Aug, 2025 1 commit

[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding... · d765cf01

Chenguang Zheng authored Aug 25, 2025


[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

d765cf01

13 Aug, 2025 1 commit
- [Core] Use individual MM items in P0/P1 cache and model runner (#22570) · 19b927e5
  Cyrus Leung authored Aug 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19b927e5
10 Aug, 2025 1 commit

[TPU] kv cache update kernel doesn't need to be padded slices to multiple of... · 2a84fb42

Chengji Yao authored Aug 09, 2025


[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>

2a84fb42

09 Aug, 2025 1 commit
- [TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
  Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9a0c5ded
05 Aug, 2025 1 commit
- [V0 Deprecation][TPU] Remove V1 flag check from tests (#22248) · 0c275ad5
  Nicolò Lucchesi authored Aug 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0c275ad5
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

25 Jul, 2025 3 commits
- [TPU][Test] Rollback PR-21550. (#21619) · 7cfea0df
  QiliangCui authored Jul 25, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  7cfea0df
- [TPU][Bugfix] fix OOM issue in CI test (#21550) · 40d86ee4
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  40d86ee4
- [TPU][Test] Temporarily suspend this MoE model in test_basic.py. (#21560) · e0be2c4d
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  e0be2c4d
24 Jul, 2025 1 commit

[TPU][Bugfix] fix moe layer (#21340) · e74bfc70

Chengji Yao authored Jul 24, 2025


Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

e74bfc70

20 Jul, 2025 1 commit
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
15 Jul, 2025 1 commit
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
09 Jul, 2025 1 commit
- [TPU][Bugfix] fix test_pallas (#20666) · eb58f595
  Chengji Yao authored Jul 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  eb58f595
08 Jul, 2025 1 commit
- [TPU][Bugfix] disable phi-3 test (#20632) · d8ee5a2c
  QiliangCui authored Jul 08, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  d8ee5a2c
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
02 Jul, 2025 1 commit
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
30 Jun, 2025 1 commit
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc