Commits · 643622ba465f0bbcb07e1d81c60dac35ed994ebf · OpenDAS / vllm_cscc

28 May, 2025 1 commit

[Hardware][TPU][V1] Multi-LoRA Optimisations for the V1 TPU backend (#15655) · 643622ba

Akshat Tripathi authored May 28, 2025


Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Signed-off-by: xihajun <junfan@krai.ai>
Signed-off-by: Jorge de Freitas <jorge.de-freitas22@imperial.ac.uk>
Signed-off-by: Jorge de Freitas <jorge@krai.ai>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: xihajun <junfan@krai.ai>
Co-authored-by: Jorge de Freitas <jorge.de-freitas22@imperial.ac.uk>
Co-authored-by: Jorge de Freitas <jorge@krai.ai>

643622ba

23 May, 2025 1 commit
- Refactor pplx init logic to make it modular (prepare for deepep) (#18200) · 6a7988c5
  youkaichao authored May 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6a7988c5
17 May, 2025 1 commit

[Hardware][TPU] Optionally import for TPU backend (#18269) · 48ac2bed

Siyuan Liu authored May 17, 2025


Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Carol Zheng <cazheng@google.com>
Co-authored-by: Jade Zheng <zheng.shoujian@outlook.com>
Co-authored-by: Hongmin Fan <fanhongmin@google.com>

48ac2bed

14 May, 2025 1 commit
- Modularize fused experts and integrate PPLX kernels (#15956) · f9c069c8
  bnellnm authored May 14, 2025
  
  f9c069c8
07 May, 2025 1 commit

[Hardware][TPU][V1] Multi-LoRA implementation for the V1 TPU backend (#14238) · c20ef40f

Akshat Tripathi authored May 07, 2025


Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

c20ef40f

25 Apr, 2025 1 commit
- [V1] Move usage stats to worker and start logging TPU hardware (#16211) · 48cb2109
  Daniel Li authored Apr 25, 2025
  
  48cb2109
22 Apr, 2025 1 commit

[TPU][V1] Capture multimodal encoder during model compilation (#15051) · 21020752

Nicolò Lucchesi authored Apr 22, 2025


Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Liu <lsiyuan@google.com>

21020752

17 Apr, 2025 1 commit
- [TPU][V1] Fix padding recompilation when `max-num-batched-tokens` is not even (#16726) · 5989f468
  Nicolò Lucchesi authored Apr 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5989f468
08 Apr, 2025 1 commit

[torch.compile][TPU] Make @support_torch_compile work for XLA backend (#15782) · 87918e40

Siyuan Liu authored Apr 07, 2025


Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

87918e40

04 Apr, 2025 1 commit
- [Bugfix][TPU] Fix V1 TPU worker for sliding window (#16059) · 70ad3f9e
  Michael Goin authored Apr 04, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  70ad3f9e
03 Apr, 2025 1 commit
- [TPU] optimize the all-reduce performance (#15903) · 01b61136
  Chengji Yao authored Apr 02, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  01b61136
29 Mar, 2025 2 commits
- [Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659) · 7c1f7600
  yarongmu-google authored Mar 28, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  7c1f7600
- [TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714) · da461f3c
  Nicolò Lucchesi authored Mar 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da461f3c
28 Mar, 2025 1 commit

[TPU] [Perf] Improve Memory Usage Estimation (#15671) · 038beded

Robert Shaw authored Mar 28, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

038beded

27 Mar, 2025 1 commit
- [TPU] support disabling xla compilation cache (#15567) · e74ff409
  Chengji Yao authored Mar 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  e74ff409
25 Mar, 2025 1 commit
- [Hardware][TPU][Bugfix] Fix v1 mp profiler (#15409) · 4157f563
  Siyuan Liu authored Mar 25, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  4157f563
21 Mar, 2025 2 commits

[v1] Refactor KVCacheConfig (#14079) · 93a00d7d
Chen Zhang authored Mar 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
93a00d7d

[V1] Scheduler Refactoring [1/N] - Add Scheduler Interface (#15250) · 0c6f5023

Woosuk Kwon authored Mar 20, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

0c6f5023

08 Mar, 2025 1 commit
- [V1] TPU - Add tensor parallel support via Ray (#13618) · cb8bdfad
  Alexander Matveev authored Mar 08, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  cb8bdfad
07 Mar, 2025 1 commit
- [Bugfix] Fix torch_xla which can't handle None seed introduced in #14274 (#14459) · 66e16a03
  yarongmu-google authored Mar 07, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  66e16a03
05 Mar, 2025 1 commit
- [V1][TPU] TPU multimodal model support for ragged attention (#14158) · fbfc3ee3
  Michael Goin authored Mar 04, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  fbfc3ee3
04 Mar, 2025 1 commit
- [TPU][Profiler] Support start_profile/stop_profile in TPU worker (#13988) · beebf474
  Siyuan Liu authored Mar 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  beebf474
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
28 Feb, 2025 1 commit

[V1][TPU] Integrate the new ragged paged attention kernel with vLLM v1 on TPU (#13379) · c3b6559a

iefgnoix authored Feb 28, 2025


Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

c3b6559a

23 Feb, 2025 1 commit
- [v1] torchrun compatibility (#13642) · eb24dc4a
  youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb24dc4a
14 Feb, 2025 1 commit
- [WIP] TPU V1 Support Refactored (#13049) · 45f90bcb
  Alexander Matveev authored Feb 14, 2025
  
  45f90bcb