Commits · 9c8b2c2a8a0bbfa0c43ed7b220642dc3e802633c · OpenDAS / vllm_cscc

24 Jul, 2025 1 commit

[TPU][Bugfix] fix moe layer (#21340) · e74bfc70

Chengji Yao authored Jul 24, 2025


Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

e74bfc70

20 Jul, 2025 1 commit
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
15 Jul, 2025 1 commit
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
09 Jul, 2025 1 commit
- [TPU][Bugfix] fix test_pallas (#20666) · eb58f595
  Chengji Yao authored Jul 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  eb58f595
08 Jul, 2025 1 commit
- [TPU][Bugfix] disable phi-3 test (#20632) · d8ee5a2c
  QiliangCui authored Jul 08, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  d8ee5a2c
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
02 Jul, 2025 1 commit
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
30 Jun, 2025 1 commit
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
26 Jun, 2025 1 commit
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
25 Jun, 2025 1 commit
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
23 Jun, 2025 1 commit
- [TPU] Fix tpu model runner test (#19995) · 33d5e29b
  Chenyaaang authored Jun 23, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  33d5e29b
16 Jun, 2025 1 commit
- [TPU] support attention head dim smaller than 128 (#19620) · a77aea59
  Chengji Yao authored Jun 15, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  a77aea59
10 Jun, 2025 1 commit
- [Core] Use tuple for kv cache group block ids (#19175) · 646d62f6
  Nick Hill authored Jun 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  646d62f6
09 Jun, 2025 1 commit
- [TPU]Fix KV cache sharing tests (#19371) · 7d44c469
  Siyuan Liu authored Jun 09, 2025
  
  7d44c469
06 Jun, 2025 1 commit
- [BugFix] Fix tpu_model_runner block_id concatenation (#19228) · 46ecc579
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  46ecc579
04 Jun, 2025 2 commits
- [TPU] Update dynamo dump file name in compilation test (#19108) · 7ee25904
  Siyuan Liu authored Jun 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  7ee25904
- [TPU] Skip hanging tests (#19115) · 8e972d9c
  Siyuan Liu authored Jun 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  8e972d9c
03 Jun, 2025 3 commits
- [V1] Support cross-layer KV sharing (#18212) · bdf13965
  Yong Hoon Shin authored Jun 03, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  bdf13965
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
30 May, 2025 1 commit
- [Bugfix][TPU] Fix tpu model runner testcase failure (#18810) · fba02e3b
  Carol Zheng authored May 30, 2025
```
Signed-off-by: Carol Zheng <cazheng@google.com>
```
  fba02e3b
08 May, 2025 1 commit
- [TPU] Fix the test_sampler (#17820) · a463555d
  Jevin Jiang authored May 08, 2025
  
  a463555d
07 May, 2025 1 commit
- [Frontend] Add missing chat templates for various MLLMs (#17758) · 8a15c260
  Cyrus Leung authored May 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a15c260
05 May, 2025 2 commits
- [TPU][V1] Add support for top-logprobs (#17072) · 5941e0b7
  Nicolò Lucchesi authored May 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5941e0b7
- [TPU] Enable gemma3-27b with TP>1 on multi-chips. (#17335) · 97659408
  XiongfeiWei authored May 05, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  97659408
01 May, 2025 1 commit
- [CI][TPU] Skip Multimodal test (#17488) · dbc18e78
  Siyuan Liu authored Apr 30, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  dbc18e78
30 Apr, 2025 1 commit
- [TPU][V1][CI] Update regression test baseline for v6 CI (#17064) · a7d5b016
  Nicolò Lucchesi authored Apr 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a7d5b016
26 Apr, 2025 1 commit
- [Core] Remove prompt string from engine core data structures (#17214) · df6f3ce8
  Nick Hill authored Apr 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  df6f3ce8
24 Apr, 2025 1 commit
- Disable enforce_eager for V1 TPU sampler and structured output tests (#17016) · 14288d13
  Michael Goin authored Apr 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  14288d13
23 Apr, 2025 1 commit
- [Core][V1][TPU] Enable structured decoding on TPU V1 (#16499) · 83d93371
  Chenyaaang authored Apr 22, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  83d93371
22 Apr, 2025 2 commits

[TPU][V1] Enable Top-P (#16843) · fa3bba2a

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

fa3bba2a

[TPU][V1] Capture multimodal encoder during model compilation (#15051) · 21020752

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Liu <lsiyuan@google.com>

21020752

21 Apr, 2025 1 commit
- [TPU][V1] Implicitly adjust page size when there's SMEM OOM (#16871) · 471fe656
  Chengji Yao authored Apr 21, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  471fe656
17 Apr, 2025 2 commits
- [V1][TPU] Enable Top K (#15489) · eb5819b2
  Nicolò Lucchesi authored Apr 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: Hyesoo Yang <hyeygit@gmail.com>
```
  eb5819b2
- [TPU][V1] Fix padding recompilation when `max-num-batched-tokens` is not even (#16726) · 5989f468
  Nicolò Lucchesi authored Apr 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5989f468
14 Apr, 2025 1 commit
- [TPU][V1] Fix exponential padding when `max-num-batched-tokens` is not a power of 2 (#16596) · b3f2fddd
  Nicolò Lucchesi authored Apr 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b3f2fddd
10 Apr, 2025 2 commits
- [TPU][V1] Disable per-request seed/Generator (#16172) · 3cc9af88
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3cc9af88
- [TPU][V1] Refine tpu_model_runner to mitigate future recompilation issues (#16275) · a4547485
  Chengji Yao authored Apr 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  a4547485
09 Apr, 2025 1 commit
- [TPU] Update PyTorch/XLA (#16288) · b1eb4ca1
  Chengji Yao authored Apr 08, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  b1eb4ca1
03 Apr, 2025 1 commit
- [TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. (#15732) · b6be6f8d
  iefgnoix authored Apr 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  b6be6f8d