Commits · fdda4d82d84d9bde0e6c01083ebaf80e5456a4e4 · OpenDAS / vllm_cscc

03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 1 commit
- [ROCm][Kernel] Add gfx950 support for skinny gemms (#18010) · 306d6040
  Charlie Fu authored May 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  306d6040
29 May, 2025 2 commits
- [ROCm][V0][Attention] Revert to the previous FA triton kernel (#18226) · 1b7cfd5a
  Gregory Shtrasberg authored May 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  1b7cfd5a
- [tests]fix start with test and async_engine · 2664c459
  zhuwenwen authored May 29, 2025
  
  2664c459
28 May, 2025 4 commits
- [Platform][Dist] Make torch distributed process group extendable (#18763) · d781930f
  Mengqing Cao authored May 28, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  d781930f
- update use_rocm_custom_paged_attention · df877aad
  zhuwenwen authored May 28, 2025
  
  df877aad
- [rocm] Fix wrong attention log (#18764) · 794ae1f5
  fxmarty-amd authored May 28, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
```
  794ae1f5
- set VLLM_FLASH_ATTN_BACKEND to use FlashAttention Backend for attention computation on rocm · 82f60bef
  zhuwenwen authored May 28, 2025
  
  82f60bef
23 May, 2025 1 commit
- [Hardware] correct method signatures for HPU,ROCm,XPU (#18551) · 60cad94b
  Ning Xie authored May 23, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  60cad94b
22 May, 2025 1 commit
- [Compile][Platform] Make PiecewiseBackend pluggable and extendable (#18076) · f8d2cc5f
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  f8d2cc5f
21 May, 2025 1 commit
- [ROCm][Kernel][V1] Enable AMD Radeon GPU Custom Paged Attention on v1 (#17004) · dd5fa7e0
  Hosang authored May 21, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  dd5fa7e0
14 May, 2025 1 commit
- Update deprecated type hinting in `platform`, `plugins`, `triton_utils`, `vllm_flash_attn` (#18129) · c8ea982d
  Harry Mellor authored May 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c8ea982d
12 May, 2025 1 commit
- [Core] Use platform-agnostic device control for DP engine core (#17245) · 289199fe
  Jade Zheng authored May 13, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  289199fe
09 May, 2025 1 commit

[FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6

vllmellm authored May 09, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

3c9396a6

08 May, 2025 1 commit

[Kernel][Hardware][AMD] Bf16 mfma opt for ROCm skinny GEMMs (#17071) · 5a499e70

Hashem Hashemi authored May 07, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: charlifu <charlifu@amd.com>

5a499e70

07 May, 2025 2 commits
- [Quantization] Quark MXFP4 format loading (#16943) · db593aa6
  Bowen Bao authored May 07, 2025
  
  db593aa6
- update rocm.py · 660af62e
  zhuwenwen authored May 07, 2025
  
  660af62e
02 May, 2025 1 commit
- [Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263) · 9352cdb5
  Xiaodong Wang authored May 02, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Lu Fang <lufang@fb.com>
```
  9352cdb5
01 May, 2025 1 commit

[ROCM] Add gfx950 to the custom attention archs (#16034) · 811a6c09

Juan Villamizar authored May 01, 2025


Signed-off-by: jpvillam <Juan.Villamizar@amd.com>
Signed-off-by: seungrokjung <seungrok.jung@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: seungrokjung <seungrok.jung@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

811a6c09

29 Apr, 2025 1 commit
- update rocm.py · 43a52016
  zhuwenwen authored Apr 29, 2025
  
  43a52016
28 Apr, 2025 1 commit
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
27 Apr, 2025 1 commit
- [MISC] Use string annotation types for class definitions (#17244) · 30215ca6
  Jade Zheng authored Apr 27, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  30215ca6
26 Apr, 2025 1 commit
- [ROCm][Misc] Follow-ups for Skinny Gemms on ROCm. (#17011) · 54271bb7
  Charlie Fu authored Apr 26, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  54271bb7
25 Apr, 2025 1 commit
- 增加per-channel 量化策略支持 · 313d629e
  gaoqiong authored Apr 25, 2025
  
  313d629e
23 Apr, 2025 1 commit
- [BugFix] Revert ROCm Custom Paged Attention Env Flag Check (#17022) · 7e081ba7
  vllmellm authored Apr 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  7e081ba7
22 Apr, 2025 3 commits

[FEAT][ROCm]: Support AITER MLA (#15893) · 30bc3e0f

vllmellm authored Apr 23, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>

30bc3e0f

[FEAT][ROCm] Integrate Paged Attention Kernel from AITER (#15001) · 0e237f00

vllmellm authored Apr 22, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

0e237f00

[Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
188b7f9b

17 Apr, 2025 1 commit
- [rocm][V0] fix selection logic for custom PA in V0 (#16426) · 95aca283
  Divakar Verma authored Apr 16, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  95aca283
11 Apr, 2025 1 commit
- add VLLM_USE_FLASH_MLA to use flashmla backend · a0e22db9
  zhuwenwen authored Apr 11, 2025
  
  a0e22db9
10 Apr, 2025 1 commit
- support flashmla backend · bb1d0df8
  zhuwenwen authored Apr 10, 2025
  
  bb1d0df8
09 Apr, 2025 1 commit
- [Hardware] add platform-specific request validation api (#16291) · cb391d85
  Joe Runde authored Apr 09, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cb391d85
07 Apr, 2025 1 commit
- [V1][Structured Output] Add `supports_structured_output()` method to Platform (#16148) · e9ba99f2
  Shanshan Shen authored Apr 07, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  e9ba99f2
04 Apr, 2025 1 commit
- [Distributed] [ROCM] Fix custom allreduce enable checks (#16010) · ef608c37
  Ilya Markov authored Apr 04, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  ef608c37
03 Apr, 2025 2 commits

[ROCM][V0] PA kennel selection when no sliding window provided (#15982) · 57a810db
Aleksandr Malyshev authored Apr 02, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
57a810db

[ROCM][KERNEL] Paged attention for V1 (#15720) · e73ff24e

Aleksandr Malyshev authored Apr 02, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: root <root@banff-cyxtera-s65-4.amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: root <root@banff-cyxtera-s65-4.amd.com>

e73ff24e

01 Apr, 2025 2 commits
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
- [fix]修复模型注册失败及其他报错 · 38571cde
  zhuwenwen authored Apr 01, 2025
  
  38571cde
25 Mar, 2025 1 commit
- [bugfix] add supports_v1 platform interface (#15417) · 5f063a80
  Joe Runde authored Mar 25, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  5f063a80
21 Mar, 2025 1 commit
- [V1] Enable Triton(ROCm) Attention backend for Nvidia GPUs (#14071) · f8a08cb9
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f8a08cb9