Commits · e3a3e4db463d5fc45def4d39d256ccf42fb70044 · OpenDAS / vllm_cscc

18 Jun, 2025 1 commit
- [Platform] Allow platform use V1 Engine by default (#19792) · 257ab954
  wangxiyuan authored Jun 18, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  257ab954
07 Jun, 2025 1 commit
- Add FlexAttention to V1 (#16078) · cf02f9b2
  Driss Guessous authored Jun 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  cf02f9b2
05 Jun, 2025 2 commits
- [V1] Use FlashInfer by default on Blackwell GPUs (#19118) · 87360308
  Michael Goin authored Jun 05, 2025
  
  87360308
- [P/D][NixlConnector] Enable FlashInfer backend (#19090) · 9ef9173c
  Nicolò Lucchesi authored Jun 05, 2025
  
  9ef9173c
04 Jun, 2025 1 commit
- [NVIDIA] Add Cutlass MLA backend (#17625) · 41aa5784
  Kaixi Hou authored Jun 04, 2025
  
  41aa5784
03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Misc] Add missing `_Backend` enums (#19081) · 4b7817c1
  Nicolò Lucchesi authored Jun 03, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  4b7817c1
28 May, 2025 1 commit
- [Platform][Dist] Make torch distributed process group extendable (#18763) · d781930f
  Mengqing Cao authored May 28, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  d781930f
27 May, 2025 1 commit

[Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c

Hyogeun Oh (오효근) authored May 27, 2025


[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>

a68e293c

23 May, 2025 1 commit
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a
22 May, 2025 1 commit
- [Compile][Platform] Make PiecewiseBackend pluggable and extendable (#18076) · f8d2cc5f
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  f8d2cc5f
14 May, 2025 1 commit
- Update deprecated type hinting in `platform`, `plugins`, `triton_utils`, `vllm_flash_attn` (#18129) · c8ea982d
  Harry Mellor authored May 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c8ea982d
13 May, 2025 1 commit
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
12 May, 2025 1 commit
- [Core] Use platform-agnostic device control for DP engine core (#17245) · 289199fe
  Jade Zheng authored May 13, 2025
```
Signed-off-by: Jade Zheng <zheng.shoujian@outlook.com>
```
  289199fe
09 May, 2025 2 commits
- [Misc] Auto fallback to float16 for pre-Ampere GPUs when detected bfloat16 config (#17265) · 5c4c08f6
  Isotr0py authored May 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5c4c08f6
- [FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6
  vllmellm authored May 09, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
```
  3c9396a6
07 May, 2025 2 commits
- [Hardware][TPU][V1] Multi-LoRA implementation for the V1 TPU backend (#14238) · c20ef40f
  Akshat Tripathi authored May 07, 2025
```
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  c20ef40f
- [Quantization] Quark MXFP4 format loading (#16943) · db593aa6
  Bowen Bao authored May 07, 2025
  
  db593aa6
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
03 May, 2025 1 commit
- [Bugfix][ROCm] Using device_type because on ROCm the API is still torch.cuda (#17601) · a9284245
  Gregory Shtrasberg authored May 03, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a9284245
28 Apr, 2025 1 commit
- [Misc] Minor typo/grammar in `platforms/interface.py` (#17307) · 889ebb26
  Nicolò Lucchesi authored Apr 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  889ebb26
22 Apr, 2025 2 commits
- [FEAT][ROCm]: Support AITER MLA (#15893) · 30bc3e0f
  vllmellm authored Apr 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
```
  30bc3e0f
- [Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
  Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
  188b7f9b
21 Apr, 2025 1 commit
- [Misc] Refactor platform to get device specific stream and event (#14411) · 7272bfae
  Shanshan Shen authored Apr 21, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  7272bfae
16 Apr, 2025 1 commit
- [Hardware] Add processor inputs to platform validation (#16680) · e1b00483
  Joe Runde authored Apr 16, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  e1b00483
14 Apr, 2025 1 commit
- config check sleep mode support oot platforms (#16562) · d2020aca
  Shuqiao Li authored Apr 15, 2025
  
  d2020aca
09 Apr, 2025 2 commits
- [Hardware] add platform-specific request validation api (#16291) · cb391d85
  Joe Runde authored Apr 09, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cb391d85
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
07 Apr, 2025 1 commit
- [V1][Structured Output] Add `supports_structured_output()` method to Platform (#16148) · e9ba99f2
  Shanshan Shen authored Apr 07, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  e9ba99f2
04 Apr, 2025 1 commit
- [Distributed] [ROCM] Fix custom allreduce enable checks (#16010) · ef608c37
  Ilya Markov authored Apr 04, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  ef608c37
25 Mar, 2025 1 commit
- [bugfix] add supports_v1 platform interface (#15417) · 5f063a80
  Joe Runde authored Mar 25, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  5f063a80
22 Mar, 2025 1 commit
- Remove openvino support in favor of external plugin (#15339) · b877031d
  Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b877031d
21 Mar, 2025 1 commit
- [V1] Enable Triton(ROCm) Attention backend for Nvidia GPUs (#14071) · f8a08cb9
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f8a08cb9
20 Mar, 2025 1 commit
- Fix env vars for running Ray distributed backend on GKE (#15166) · a8f12a63
  Richard Liu authored Mar 20, 2025
```
Signed-off-by: Richard Liu <ricliu@google.com>
```
  a8f12a63
11 Mar, 2025 1 commit
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
03 Mar, 2025 1 commit
- [Misc][Platform] Move use allgather to platform (#14010) · b87c21fc
  Mengqing Cao authored Mar 03, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  b87c21fc
27 Feb, 2025 3 commits

[Attention] Flash MLA for V1 (#13867) · 2e94b9cf

Lucas Wilkinson authored Feb 27, 2025


Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yang Chen <yangche@fb.com>

2e94b9cf

[Attention] MLA support for V1 (#13789) · 58d1b2aa
Yang Chen authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
58d1b2aa

[Kernel] FlashMLA integration (#13747) · f9590390

Lucas Wilkinson authored Feb 26, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

f9590390

17 Feb, 2025 1 commit
- [MISC] tiny fixes (#13378) · 238dfc8a
  Mengqing Cao authored Feb 17, 2025
  
  238dfc8a