Commits · 641fc5b7f64b57ab020df81bc7d360cbd7e76344 · OpenDAS / vllm_cscc

14 Apr, 2025 1 commit
- remove unused code · 641fc5b7
  zhuwenwen authored Apr 14, 2025
  
  641fc5b7
11 Apr, 2025 1 commit
- add VLLM_USE_FLASH_MLA to use flashmla backend · a0e22db9
  zhuwenwen authored Apr 11, 2025
  
  a0e22db9
10 Apr, 2025 1 commit
- support flashmla backend · bb1d0df8
  zhuwenwen authored Apr 10, 2025
  
  bb1d0df8
04 Apr, 2025 2 commits
- [Distributed] [ROCM] Fix custom allreduce enable checks (#16010) · ef608c37
  Ilya Markov authored Apr 04, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  ef608c37
- [CPU] Change default block_size for CPU backend (#16002) · 2386803f
  Li, Jiang authored Apr 05, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  2386803f
03 Apr, 2025 2 commits

[ROCM][V0] PA kennel selection when no sliding window provided (#15982) · 57a810db
Aleksandr Malyshev authored Apr 02, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
57a810db

[ROCM][KERNEL] Paged attention for V1 (#15720) · e73ff24e

Aleksandr Malyshev authored Apr 02, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: root <root@banff-cyxtera-s65-4.amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: root <root@banff-cyxtera-s65-4.amd.com>

e73ff24e

01 Apr, 2025 2 commits
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
- [fix]修复模型注册失败及其他报错 · 38571cde
  zhuwenwen authored Apr 01, 2025
  
  38571cde
28 Mar, 2025 1 commit

[Bugfix] Fix failure to launch in Tensor Parallel TP mode on macOS. (#14948) · 4e0f6076

Kebe authored Mar 28, 2025


Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4e0f6076

25 Mar, 2025 2 commits
- [bugfix] add supports_v1 platform interface (#15417) · 5f063a80
  Joe Runde authored Mar 25, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  5f063a80
- [Kernel][CPU] CPU MLA (#14744) · 4f044b1d
  Thien Tran authored Mar 25, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  4f044b1d
24 Mar, 2025 1 commit

[Doc] Update docs on handling OOM (#15357) · 6dd55af6

Cyrus Leung authored Mar 25, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

6dd55af6

23 Mar, 2025 1 commit

[V1] Enable V1 Fp8 cache for FA3 in the oracle (#15191) · dccf535f

Lucas Wilkinson authored Mar 23, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

dccf535f

22 Mar, 2025 1 commit
- Remove openvino support in favor of external plugin (#15339) · b877031d
  Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b877031d
21 Mar, 2025 1 commit
- [V1] Enable Triton(ROCm) Attention backend for Nvidia GPUs (#14071) · f8a08cb9
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f8a08cb9
20 Mar, 2025 2 commits
- Fix env vars for running Ray distributed backend on GKE (#15166) · a8f12a63
  Richard Liu authored Mar 20, 2025
```
Signed-off-by: Richard Liu <ricliu@google.com>
```
  a8f12a63
- [Attention] Flash Attention 3 - fp8 (#14570) · a597a575
  Mickaël Seznec authored Mar 20, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  a597a575
17 Mar, 2025 2 commits
- [Misc][XPU] Use None as device capacity for XPU (#14932) · 9b87a579
  Yan Ma authored Mar 17, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  9b87a579
- [BugFix] Fix MLA + V1 + TP==1 causing reinitialization of cuda context (#14910) · 1e799b7e
  Lucas Wilkinson authored Mar 16, 2025
  
  1e799b7e
15 Mar, 2025 1 commit
- [CPU] Support FP8 KV cache (#14741) · a2ae4965
  Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a2ae4965
14 Mar, 2025 2 commits
- 增加deepseek v3 block-int8量化支持 · ba1ff372
  zhuwenwen authored Mar 14, 2025
```
增加线性int8 gemm配置
```
  ba1ff372
- [V1] TPU - Enable prefix caching by default (#14773) · 7888e1d0
  Alexander Matveev authored Mar 13, 2025
  
  7888e1d0
13 Mar, 2025 1 commit
- [V1][TPU] Add assertion on multi-step-scheduler (#14707) · 1bc3b739
  Siyuan Liu authored Mar 12, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  1bc3b739
12 Mar, 2025 1 commit

[CPU] Upgrade CPU backend to torch-2.6 (#13381) · ff47aab0

Li, Jiang authored Mar 12, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

ff47aab0

11 Mar, 2025 2 commits
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
- [Neuron] Add Neuron device communicator for vLLM v1 (#14085) · d6123170
  gnovack authored Mar 10, 2025
  
  d6123170
10 Mar, 2025 1 commit
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f
09 Mar, 2025 1 commit

[Attention] Default to FlashMLA backend for MLA (#14451) · b0d54194

Lucas Wilkinson authored Mar 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

b0d54194

05 Mar, 2025 2 commits
- [platforms] improve rocm debugging info (#14257) · 6eaf9302
  youkaichao authored Mar 05, 2025
  
  6eaf9302
- [V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
  Tyler Michael Smith authored Mar 05, 2025
  
  72c62eae
04 Mar, 2025 3 commits
- [Bugfix] Restrict MacOS CPU detection (#14210) · 6247bae6
  Michael Goin authored Mar 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6247bae6
- [platform] add debug logging during inferring the device type (#14195) · ac65bc92
  youkaichao authored Mar 04, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ac65bc92
- [Misc] Remove lru_cache in NvmlCudaPlatform (#14156) · 989f4f43
  Cody Yu authored Mar 03, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  989f4f43
03 Mar, 2025 1 commit
- [Misc][Platform] Move use allgather to platform (#14010) · b87c21fc
  Mengqing Cao authored Mar 03, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  b87c21fc
01 Mar, 2025 1 commit
- [V1][Minor] Do not print attn backend twice (#13985) · 3b5567a2
  Woosuk Kwon authored Feb 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3b5567a2
27 Feb, 2025 3 commits

[Attention] Flash MLA for V1 (#13867) · 2e94b9cf

Lucas Wilkinson authored Feb 27, 2025


Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yang Chen <yangche@fb.com>

2e94b9cf

[Attention] MLA support for V1 (#13789) · 58d1b2aa
Yang Chen authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
58d1b2aa

[Kernel] FlashMLA integration (#13747) · f9590390

Lucas Wilkinson authored Feb 26, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

f9590390

25 Feb, 2025 1 commit
- update rocm.py · 601057c9
  zhuwenwen authored Feb 25, 2025
  
  601057c9