Commits · 1e799b7ec1b1c61952d2ae24c85ecf3fcb0f6de3 · OpenDAS / vllm_cscc

17 Mar, 2025 1 commit
- [BugFix] Fix MLA + V1 + TP==1 causing reinitialization of cuda context (#14910) · 1e799b7e
  Lucas Wilkinson authored Mar 16, 2025
  
  1e799b7e
15 Mar, 2025 1 commit
- [CPU] Support FP8 KV cache (#14741) · a2ae4965
  Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a2ae4965
14 Mar, 2025 1 commit
- [V1] TPU - Enable prefix caching by default (#14773) · 7888e1d0
  Alexander Matveev authored Mar 13, 2025
  
  7888e1d0
13 Mar, 2025 1 commit
- [V1][TPU] Add assertion on multi-step-scheduler (#14707) · 1bc3b739
  Siyuan Liu authored Mar 12, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  1bc3b739
12 Mar, 2025 1 commit

[CPU] Upgrade CPU backend to torch-2.6 (#13381) · ff47aab0

Li, Jiang authored Mar 12, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

ff47aab0

11 Mar, 2025 2 commits
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
- [Neuron] Add Neuron device communicator for vLLM v1 (#14085) · d6123170
  gnovack authored Mar 10, 2025
  
  d6123170
10 Mar, 2025 1 commit
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f
09 Mar, 2025 1 commit

[Attention] Default to FlashMLA backend for MLA (#14451) · b0d54194

Lucas Wilkinson authored Mar 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

b0d54194

05 Mar, 2025 2 commits
- [platforms] improve rocm debugging info (#14257) · 6eaf9302
  youkaichao authored Mar 05, 2025
  
  6eaf9302
- [V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
  Tyler Michael Smith authored Mar 05, 2025
  
  72c62eae
04 Mar, 2025 3 commits
- [Bugfix] Restrict MacOS CPU detection (#14210) · 6247bae6
  Michael Goin authored Mar 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6247bae6
- [platform] add debug logging during inferring the device type (#14195) · ac65bc92
  youkaichao authored Mar 04, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ac65bc92
- [Misc] Remove lru_cache in NvmlCudaPlatform (#14156) · 989f4f43
  Cody Yu authored Mar 03, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  989f4f43
03 Mar, 2025 1 commit
- [Misc][Platform] Move use allgather to platform (#14010) · b87c21fc
  Mengqing Cao authored Mar 03, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  b87c21fc
01 Mar, 2025 1 commit
- [V1][Minor] Do not print attn backend twice (#13985) · 3b5567a2
  Woosuk Kwon authored Feb 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3b5567a2
27 Feb, 2025 3 commits

[Attention] Flash MLA for V1 (#13867) · 2e94b9cf

Lucas Wilkinson authored Feb 27, 2025


Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yang Chen <yangche@fb.com>

2e94b9cf

[Attention] MLA support for V1 (#13789) · 58d1b2aa
Yang Chen authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
58d1b2aa

[Kernel] FlashMLA integration (#13747) · f9590390

Lucas Wilkinson authored Feb 26, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

f9590390

25 Feb, 2025 1 commit
- [Misc] set single whitespace between log sentences (#13771) · 51010a18
  cjackal authored Feb 25, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  51010a18
20 Feb, 2025 1 commit
- [Misc] Warn if the vLLM version can't be retrieved (#13501) · 96216678
  Alex Brooks authored Feb 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
```
  96216678
18 Feb, 2025 2 commits
- [ROCm] Make amdsmi import optional for other platforms (#13460) · 435b502a
  Cyrus Leung authored Feb 18, 2025
  
  435b502a
- [ROCm] fix get_device_name for rocm (#13438) · 7c7adf81
  Divakar Verma authored Feb 17, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  7c7adf81
17 Feb, 2025 2 commits
- [Bugfix] fix xpu communicator (#13368) · 30513d1c
  Yan Ma authored Feb 17, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  30513d1c
- [MISC] tiny fixes (#13378) · 238dfc8a
  Mengqing Cao authored Feb 17, 2025
  
  238dfc8a
16 Feb, 2025 3 commits
- [Bugfix][Platform][CPU] Fix cuda platform detection on CPU backend edge case (#13358) · d67cc21b
  Isotr0py authored Feb 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d67cc21b
- [platform] add base class for communicators (#13208) · a0231b7c
  youkaichao authored Feb 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a0231b7c
- [V1][Spec Decode] Ngram Spec Decode (#12193) · 80f63a39
  Lily Liu authored Feb 15, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  80f63a39
14 Feb, 2025 2 commits
- [WIP] TPU V1 Support Refactored (#13049) · 45f90bcb
  Alexander Matveev authored Feb 14, 2025
  
  45f90bcb
- [ROCm][V1] Add intial ROCm support to V1 (#12790) · ba59b78a
  Sage Moore authored Feb 13, 2025
  
  ba59b78a
11 Feb, 2025 4 commits
- [CI/Build][Bugfix] Fix CPU backend default threads num (#13077) · 565c1efa
  Li, Jiang authored Feb 12, 2025
  
  565c1efa
- [Platform] add pre_register_and_update function (#12432) · 2e3b969e
  wangxiyuan authored Feb 11, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2e3b969e
- [ROCm] Using a more precise memory profiling (#12624) · 7539bbc6
  Gregory Shtrasberg authored Feb 11, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  7539bbc6
- [Core] Don't do platform detection at import time (#12933) · c320ca8e
  Russell Bryant authored Feb 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c320ca8e
10 Feb, 2025 2 commits
- Fix seed parameter behavior in vLLM (#13007) · 2ae88905
  மனோஜ்குமார் பழனிச்சாமி authored Feb 10, 2025
```
Signed-off-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
```
  2ae88905
- Check if selected backend is None in get_attn_backend_cls() (#12975) · 44607e07
  Yuan Tang authored Feb 09, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  44607e07
07 Feb, 2025 1 commit

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation... · eaa92d44

TJian authored Feb 08, 2025

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

eaa92d44

06 Feb, 2025 1 commit
- [Misc] Improve error message for incorrect pynvml (#12809) · 0408efc6
  youkaichao authored Feb 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0408efc6
05 Feb, 2025 1 commit
- [core][distributed] exact ray placement control (#12732) · bc1bdece
  youkaichao authored Feb 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bc1bdece
04 Feb, 2025 1 commit

[AMD][ROCm] Enable DeepSeek model on ROCm (#12662) · c36ac98d

Hongxia Yang authored Feb 04, 2025


Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

c36ac98d