Commits · 9a0c5ded5aef022d2cfd1a263cd1fecdeb6697be · OpenDAS / vllm_cscc

09 Aug, 2025 1 commit
- [TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
  Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9a0c5ded
05 Aug, 2025 1 commit
- [V0 Deprecation][TPU] Remove V1 flag check from tests (#22248) · 0c275ad5
  Nicolò Lucchesi authored Aug 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0c275ad5
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

25 Jul, 2025 3 commits
- [TPU][Test] Rollback PR-21550. (#21619) · 7cfea0df
  QiliangCui authored Jul 25, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  7cfea0df
- [TPU][Bugfix] fix OOM issue in CI test (#21550) · 40d86ee4
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  40d86ee4
- [TPU][Test] Temporarily suspend this MoE model in test_basic.py. (#21560) · e0be2c4d
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  e0be2c4d
24 Jul, 2025 1 commit

[TPU][Bugfix] fix moe layer (#21340) · e74bfc70

Chengji Yao authored Jul 24, 2025


Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

e74bfc70

20 Jul, 2025 1 commit
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
15 Jul, 2025 1 commit
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
09 Jul, 2025 1 commit
- [TPU][Bugfix] fix test_pallas (#20666) · eb58f595
  Chengji Yao authored Jul 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  eb58f595
08 Jul, 2025 1 commit
- [TPU][Bugfix] disable phi-3 test (#20632) · d8ee5a2c
  QiliangCui authored Jul 08, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  d8ee5a2c
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
02 Jul, 2025 1 commit
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
30 Jun, 2025 1 commit
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
26 Jun, 2025 1 commit
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
25 Jun, 2025 1 commit
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
23 Jun, 2025 1 commit
- [TPU] Fix tpu model runner test (#19995) · 33d5e29b
  Chenyaaang authored Jun 23, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  33d5e29b
16 Jun, 2025 1 commit
- [TPU] support attention head dim smaller than 128 (#19620) · a77aea59
  Chengji Yao authored Jun 15, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  a77aea59
10 Jun, 2025 1 commit
- [Core] Use tuple for kv cache group block ids (#19175) · 646d62f6
  Nick Hill authored Jun 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  646d62f6
09 Jun, 2025 1 commit
- [TPU]Fix KV cache sharing tests (#19371) · 7d44c469
  Siyuan Liu authored Jun 09, 2025
  
  7d44c469
06 Jun, 2025 1 commit
- [BugFix] Fix tpu_model_runner block_id concatenation (#19228) · 46ecc579
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  46ecc579
04 Jun, 2025 2 commits
- [TPU] Update dynamo dump file name in compilation test (#19108) · 7ee25904
  Siyuan Liu authored Jun 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  7ee25904
- [TPU] Skip hanging tests (#19115) · 8e972d9c
  Siyuan Liu authored Jun 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  8e972d9c
03 Jun, 2025 3 commits
- [V1] Support cross-layer KV sharing (#18212) · bdf13965
  Yong Hoon Shin authored Jun 03, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  bdf13965
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
30 May, 2025 1 commit
- [Bugfix][TPU] Fix tpu model runner testcase failure (#18810) · fba02e3b
  Carol Zheng authored May 30, 2025
```
Signed-off-by: Carol Zheng <cazheng@google.com>
```
  fba02e3b
08 May, 2025 1 commit
- [TPU] Fix the test_sampler (#17820) · a463555d
  Jevin Jiang authored May 08, 2025
  
  a463555d
07 May, 2025 1 commit
- [Frontend] Add missing chat templates for various MLLMs (#17758) · 8a15c260
  Cyrus Leung authored May 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a15c260
05 May, 2025 2 commits
- [TPU][V1] Add support for top-logprobs (#17072) · 5941e0b7
  Nicolò Lucchesi authored May 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5941e0b7
- [TPU] Enable gemma3-27b with TP>1 on multi-chips. (#17335) · 97659408
  XiongfeiWei authored May 05, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  97659408
01 May, 2025 1 commit
- [CI][TPU] Skip Multimodal test (#17488) · dbc18e78
  Siyuan Liu authored Apr 30, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  dbc18e78
30 Apr, 2025 1 commit
- [TPU][V1][CI] Update regression test baseline for v6 CI (#17064) · a7d5b016
  Nicolò Lucchesi authored Apr 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a7d5b016
26 Apr, 2025 1 commit
- [Core] Remove prompt string from engine core data structures (#17214) · df6f3ce8
  Nick Hill authored Apr 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  df6f3ce8
24 Apr, 2025 1 commit
- Disable enforce_eager for V1 TPU sampler and structured output tests (#17016) · 14288d13
  Michael Goin authored Apr 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  14288d13
23 Apr, 2025 1 commit
- [Core][V1][TPU] Enable structured decoding on TPU V1 (#16499) · 83d93371
  Chenyaaang authored Apr 22, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  83d93371
22 Apr, 2025 2 commits

[TPU][V1] Enable Top-P (#16843) · fa3bba2a

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

fa3bba2a

[TPU][V1] Capture multimodal encoder during model compilation (#15051) · 21020752

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Liu <lsiyuan@google.com>

21020752

21 Apr, 2025 1 commit
- [TPU][V1] Implicitly adjust page size when there's SMEM OOM (#16871) · 471fe656
  Chengji Yao authored Apr 21, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  471fe656
17 Apr, 2025 1 commit

[V1][TPU] Enable Top K (#15489) · eb5819b2

Nicolò Lucchesi authored Apr 17, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: Hyesoo Yang <hyeygit@gmail.com>

eb5819b2