Commits · 02f0c7b220422792f5e53de2a7d51d2d3ff2df28 · OpenDAS / vllm_cscc · GitLab

03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 1 commit
- [ROCm][Kernel] Add gfx950 support for skinny gemms (#18010) · 306d6040
  Charlie Fu authored May 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  306d6040
29 May, 2025 1 commit
- [ROCm][V0][Attention] Revert to the previous FA triton kernel (#18226) · 1b7cfd5a
  Gregory Shtrasberg authored May 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  1b7cfd5a
28 May, 2025 2 commits
- [Platform][Dist] Make torch distributed process group extendable (#18763) · d781930f
  Mengqing Cao authored May 28, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  d781930f
- [rocm] Fix wrong attention log (#18764) · 794ae1f5
  fxmarty-amd authored May 28, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
```
  794ae1f5
23 May, 2025 1 commit
- [Hardware] correct method signatures for HPU,ROCm,XPU (#18551) · 60cad94b
  Ning Xie authored May 23, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  60cad94b
22 May, 2025 1 commit
- [Compile][Platform] Make PiecewiseBackend pluggable and extendable (#18076) · f8d2cc5f
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  f8d2cc5f
21 May, 2025 1 commit
- [ROCm][Kernel][V1] Enable AMD Radeon GPU Custom Paged Attention on v1 (#17004) · dd5fa7e0
  Hosang authored May 21, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  dd5fa7e0
14 May, 2025 1 commit
- Update deprecated type hinting in `platform`, `plugins`, `triton_utils`, `vllm_flash_attn` (#18129) · c8ea982d
  Harry Mellor authored May 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c8ea982d
12 May, 2025 1 commit
- [Core] Use platform-agnostic device control for DP engine core (#17245) · 289199fe
  Jade Zheng authored May 13, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  289199fe
09 May, 2025 1 commit

[FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6

vllmellm authored May 09, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

3c9396a6

08 May, 2025 1 commit

[Kernel][Hardware][AMD] Bf16 mfma opt for ROCm skinny GEMMs (#17071) · 5a499e70

Hashem Hashemi authored May 07, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: charlifu <charlifu@amd.com>

5a499e70

07 May, 2025 1 commit
- [Quantization] Quark MXFP4 format loading (#16943) · db593aa6
  Bowen Bao authored May 07, 2025
  
  db593aa6
02 May, 2025 1 commit
- [Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263) · 9352cdb5
  Xiaodong Wang authored May 02, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Lu Fang <lufang@fb.com>
```
  9352cdb5
01 May, 2025 1 commit

[ROCM] Add gfx950 to the custom attention archs (#16034) · 811a6c09

Juan Villamizar authored May 01, 2025


Signed-off-by: jpvillam <Juan.Villamizar@amd.com>
Signed-off-by: seungrokjung <seungrok.jung@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: seungrokjung <seungrok.jung@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

811a6c09

28 Apr, 2025 1 commit
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
27 Apr, 2025 1 commit
- [MISC] Use string annotation types for class definitions (#17244) · 30215ca6
  Jade Zheng authored Apr 27, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  30215ca6
26 Apr, 2025 1 commit
- [ROCm][Misc] Follow-ups for Skinny Gemms on ROCm. (#17011) · 54271bb7
  Charlie Fu authored Apr 26, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  54271bb7
23 Apr, 2025 1 commit
- [BugFix] Revert ROCm Custom Paged Attention Env Flag Check (#17022) · 7e081ba7
  vllmellm authored Apr 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  7e081ba7
22 Apr, 2025 3 commits

[FEAT][ROCm]: Support AITER MLA (#15893) · 30bc3e0f

vllmellm authored Apr 23, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>

30bc3e0f

[FEAT][ROCm] Integrate Paged Attention Kernel from AITER (#15001) · 0e237f00

vllmellm authored Apr 22, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

0e237f00

[Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
188b7f9b

17 Apr, 2025 1 commit
- [rocm][V0] fix selection logic for custom PA in V0 (#16426) · 95aca283
  Divakar Verma authored Apr 16, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  95aca283
09 Apr, 2025 1 commit
- [Hardware] add platform-specific request validation api (#16291) · cb391d85
  Joe Runde authored Apr 09, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cb391d85
07 Apr, 2025 1 commit
- [V1][Structured Output] Add `supports_structured_output()` method to Platform (#16148) · e9ba99f2
  Shanshan Shen authored Apr 07, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  e9ba99f2
04 Apr, 2025 1 commit
- [Distributed] [ROCM] Fix custom allreduce enable checks (#16010) · ef608c37
  Ilya Markov authored Apr 04, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  ef608c37
03 Apr, 2025 2 commits

[ROCM][V0] PA kennel selection when no sliding window provided (#15982) · 57a810db
Aleksandr Malyshev authored Apr 02, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
57a810db

[ROCM][KERNEL] Paged attention for V1 (#15720) · e73ff24e

Aleksandr Malyshev authored Apr 02, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: root <root@banff-cyxtera-s65-4.amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: root <root@banff-cyxtera-s65-4.amd.com>

e73ff24e

01 Apr, 2025 1 commit
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
25 Mar, 2025 1 commit
- [bugfix] add supports_v1 platform interface (#15417) · 5f063a80
  Joe Runde authored Mar 25, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  5f063a80
21 Mar, 2025 1 commit
- [V1] Enable Triton(ROCm) Attention backend for Nvidia GPUs (#14071) · f8a08cb9
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f8a08cb9
11 Mar, 2025 1 commit
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
10 Mar, 2025 1 commit
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f
18 Feb, 2025 2 commits
- [ROCm] Make amdsmi import optional for other platforms (#13460) · 435b502a
  Cyrus Leung authored Feb 18, 2025
  
  435b502a
- [ROCm] fix get_device_name for rocm (#13438) · 7c7adf81
  Divakar Verma authored Feb 17, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  7c7adf81
16 Feb, 2025 1 commit
- [platform] add base class for communicators (#13208) · a0231b7c
  youkaichao authored Feb 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a0231b7c
14 Feb, 2025 1 commit
- [ROCm][V1] Add intial ROCm support to V1 (#12790) · ba59b78a
  Sage Moore authored Feb 13, 2025
  
  ba59b78a
11 Feb, 2025 1 commit
- [ROCm] Using a more precise memory profiling (#12624) · 7539bbc6
  Gregory Shtrasberg authored Feb 11, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  7539bbc6
07 Feb, 2025 1 commit

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation... · eaa92d44

TJian authored Feb 08, 2025

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

eaa92d44

04 Feb, 2025 1 commit

[AMD][ROCm] Enable DeepSeek model on ROCm (#12662) · c36ac98d

Hongxia Yang authored Feb 04, 2025


Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

c36ac98d