Commits · fa3bba2a538de76c630f75de160bfb43e4e1cd4b · OpenDAS / vllm_cscc

22 Apr, 2025 2 commits

[TPU][V1] Enable Top-P (#16843) · fa3bba2a

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

fa3bba2a

[TPU][V1] Capture multimodal encoder during model compilation (#15051) · 21020752

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Liu <lsiyuan@google.com>

21020752

21 Apr, 2025 1 commit
- [TPU][V1] Implicitly adjust page size when there's SMEM OOM (#16871) · 471fe656
  Chengji Yao authored Apr 21, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  471fe656
17 Apr, 2025 2 commits
- [V1][TPU] Enable Top K (#15489) · eb5819b2
  Nicolò Lucchesi authored Apr 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: Hyesoo Yang <hyeygit@gmail.com>
```
  eb5819b2
- [TPU][V1] Fix padding recompilation when `max-num-batched-tokens` is not even (#16726) · 5989f468
  Nicolò Lucchesi authored Apr 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5989f468
14 Apr, 2025 1 commit
- [TPU][V1] Fix exponential padding when `max-num-batched-tokens` is not a power of 2 (#16596) · b3f2fddd
  Nicolò Lucchesi authored Apr 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b3f2fddd
10 Apr, 2025 2 commits
- [TPU][V1] Disable per-request seed/Generator (#16172) · 3cc9af88
  Nicolò Lucchesi authored Apr 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3cc9af88
- [TPU][V1] Refine tpu_model_runner to mitigate future recompilation issues (#16275) · a4547485
  Chengji Yao authored Apr 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  a4547485
09 Apr, 2025 1 commit
- [TPU] Update PyTorch/XLA (#16288) · b1eb4ca1
  Chengji Yao authored Apr 08, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  b1eb4ca1
03 Apr, 2025 2 commits
- [TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. (#15732) · b6be6f8d
  iefgnoix authored Apr 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  b6be6f8d
- [V1][TPU] TPU-optimized top-p implementation (avoids scattering). (#15736) · 1b84eff0
  Hyesoo Yang authored Apr 02, 2025
```
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
Co-authored-by: root <root@t1v-n-822696b7-w-0.us-central2-b.c.tpu-prod-env-large-adhoc.internal>
```
  1b84eff0
31 Mar, 2025 1 commit
- [V1] TPU CI - Add basic perf regression test (#15414) · 9a2160fa
  Alexander Matveev authored Mar 31, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9a2160fa
28 Mar, 2025 3 commits
- [V1] TPU - Fix the chunked prompt bug (#15713) · c3f687ac
  Alexander Matveev authored Mar 28, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  c3f687ac
- [TPU][CI] Fix TPUModelRunner Test (#15667) · 2d9045fc
  Robert Shaw authored Mar 28, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  2d9045fc
- [CI][TPU] Temporarily Disable Quant Test on TPU (#15649) · 8a49eea7
  Robert Shaw authored Mar 27, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  8a49eea7
27 Mar, 2025 1 commit
- [Bugfix][TPU][V1] Fix recompilation (#15553) · 4098b722
  Nicolò Lucchesi authored Mar 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4098b722
25 Mar, 2025 2 commits

[core] add bucket padding to tpu_model_runner (#14995) · ac3cd6e8

Chenyaaang authored Mar 25, 2025


Signed-off-by: Chenyaaang <llccyy1212@gmail.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>

ac3cd6e8

[CI/Build] Add tests for the V1 tpu_model_runner. (#14843) · 0a049c7d
yarongmu-google authored Mar 25, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
0a049c7d

21 Mar, 2025 2 commits
- [TPU][V1] MHA Pallas backend (#15288) · cfbb8c93
  Nicolò Lucchesi authored Mar 21, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  cfbb8c93
- [V1][TPU] Speed up top-k on TPU by using torch.topk (#15242) · 47195057
  Hyesoo Yang authored Mar 20, 2025
```
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
```
  47195057
20 Mar, 2025 1 commit
- [V1][TPU] Support V1 Sampler for ragged attention (#14227) · d8c6d7d6
  Nicolò Lucchesi authored Mar 20, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d8c6d7d6
18 Mar, 2025 1 commit
- [V1] TPU - CI/CD use smaller model (#15054) · 72a8639b
  Alexander Matveev authored Mar 18, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  72a8639b
17 Mar, 2025 1 commit

[Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e

Sibi authored Mar 17, 2025


Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

a73e183e

08 Mar, 2025 1 commit
- [V1] TPU - Add tensor parallel support via Ray (#13618) · cb8bdfad
  Alexander Matveev authored Mar 08, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  cb8bdfad