Commits · 497a91e9f77b7dba4a2501b1942e088bc01fb328 · OpenDAS / vllm_cscc

11 Jun, 2025 2 commits
- [CI] Update FlashInfer to 0.2.6.post1 (#19297) · 497a91e9
  Michael Goin authored Jun 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  497a91e9
- [BugFix] Fix docker build cpu-dev image error (#19394) · a45b979d
  niu_he authored Jun 11, 2025
```
Signed-off-by: niu_he <carlton2tang@gmail.com>
```
  a45b979d
07 Jun, 2025 1 commit
- [AMD] Update compatible packaging version (#19309) · 88be823d
  pramenku authored Jun 07, 2025
```
Signed-off-by: pramkuma <Pramendra.Kumar@amd.com>
```
  88be823d
06 Jun, 2025 2 commits

[Build][ROCm] Update Dockerfile.rocm (#19296) · e010688f
Alexei-V-Ivanov-AMD authored Jun 06, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
e010688f

Fixed ppc build when it runs on non-RHEL based linux distros (#18422) · 94ecee62

Nishidha authored Jun 07, 2025

Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
Signed-off-by: Md. Shafi Hussain <Md.Shafi.Hussain@ibm.com>
Signed-off-by: npanpaliya <nishidha.panpaliya@partner.ibm.com>
Co-authored-by: Md. Shafi Hussain <Md.Shafi.Hussain@ibm.com>

94ecee62

05 Jun, 2025 1 commit
- [Torch Nightly]add missing dependency (#18770) · 25b918ee
  Yang Wang authored Jun 04, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  25b918ee
03 Jun, 2025 3 commits
- [Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) · d32aa2e6
  Lu Fang authored Jun 03, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  d32aa2e6
- [ROCm][Build] Clean up the ROCm build (#19040) · 9e6f61e8
  Gregory Shtrasberg authored Jun 02, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  9e6f61e8
- [CPU][CI] Re-enable the CPU CI tests (#19046) · 8655f47f
  Li, Jiang authored Jun 03, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  8655f47f
23 May, 2025 4 commits
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- Use prebuilt FlashInfer x86_64 PyTorch 2.7 CUDA 12.8 wheel for CI (#18537) · 1645b601
  Huy Do authored May 23, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  1645b601
- [Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to... · 7ab056c2
  Kay Yan authored May 23, 2025
```
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to `requirements/cpu.txt`  (#18542)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  7ab056c2
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
22 May, 2025 2 commits

[Build/CI] Fix CUDA 11.8 build (#17679) · 6e588da0

Tyler Michael Smith authored May 22, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

6e588da0

[Neuron] Update Dockerfile.neuron to use latest neuron release (2.23) (#18512) · e2d7d312
Satyajith Chilappagari authored May 22, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
e2d7d312

21 May, 2025 2 commits
- [FEAT][ROCm] Upgrade AITER MLA v1 backend (#18338) · 94d8ec8d
  vllmellm authored May 22, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  94d8ec8d
- [Build] fix Dockerfile shell (#18402) · 371376f9
  Kebe authored May 21, 2025
  
  371376f9
20 May, 2025 1 commit
- fix:Build torch wheel inline rather than picking from nightly (#18351) · 23baa218
  Dilip Gowda Bhagavan authored May 21, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  23baa218
19 May, 2025 1 commit
- [Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) · 47fda6d0
  Simon Mo authored May 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  47fda6d0
17 May, 2025 2 commits
- Fixed build on ppc64le due to openssl conflicts (#18262) · f880d425
  Nishidha authored May 17, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  f880d425
- Update Dockerfile to build for Blackwell (#18095) · dcfe9523
  Michael Goin authored May 17, 2025
  
  dcfe9523
16 May, 2025 1 commit
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
09 May, 2025 1 commit

[FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6

vllmellm authored May 09, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

3c9396a6

07 May, 2025 1 commit
- Add logging for torch nightly version (#17669) · 6de3e134
  Yang Wang authored May 06, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  6de3e134
01 May, 2025 2 commits
- [ROCm] Effort to reduce the number of environment variables in command line (#17229) · 90d0a54c
  Hongxia Yang authored May 01, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  90d0a54c
- FIxing the AMD test failures caused by PR#16457 (#17511) · 7ab643e4
  Alexei-V-Ivanov-AMD authored May 01, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  7ab643e4
30 Apr, 2025 2 commits
- [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) · ed6cfb90
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  ed6cfb90
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
29 Apr, 2025 3 commits
- Fix: Python package installation for opentelmetry (#17049) · c9c1b59e
  Dilip Gowda Bhagavan authored Apr 30, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  c9c1b59e
- [CI/Build] Add retry mechanism for add-apt-repository (#17107) · 08e15def
  Reid authored Apr 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  08e15def
- [TPU][V1][CI] Replace `python3 setup.py develop` with standard `pip install --e` on TPU (#17374) · 792595b5
  Nicolò Lucchesi authored Apr 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  792595b5
28 Apr, 2025 1 commit
- [Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261) · d1aeea75
  Lennart K. M. Schulz authored Apr 28, 2025
```
Signed-off-by: lkm-schulz <44176356+lkm-schulz@users.noreply.github.com>
```
  d1aeea75
23 Apr, 2025 2 commits
- [CI/Build] workaround for CI build failure (#17070) · b07d7416
  Sangyeon Cho authored Apr 24, 2025
```
Signed-off-by: csy1204 <josang1204@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b07d7416
- add Dockerfile build vllm against torch nightly (#16936) · f67e9e9f
  Yang Wang authored Apr 22, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  f67e9e9f
22 Apr, 2025 2 commits

[FEAT][ROCm] Integrate Paged Attention Kernel from AITER (#15001) · 0e237f00

vllmellm authored Apr 22, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

0e237f00

[ROCm] Add aiter tkw1 kernel for Llama4 fp8 (#16727) · 5b794cae

kliuae authored Apr 22, 2025


Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

5b794cae

18 Apr, 2025 1 commit
- [Misc] add collect_env to cli and docker image (#16759) · 7bdfd29a
  rongfu.leng authored Apr 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  7bdfd29a
16 Apr, 2025 1 commit
- [Bugfix] fix gpu docker image mis benchmarks dir (#16628) · 96bb8aa6
  rongfu.leng authored Apr 16, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  96bb8aa6
14 Apr, 2025 2 commits
- s390x: Fix PyArrow build and add CPU test script for Buildkite CI (#16036) · 7b5ecf79
  Nishan Acharya authored Apr 14, 2025
```
Signed-off-by: Nishan Acharya <Nishan.Acharya@ibm.com>
```
  7b5ecf79
- [fix]: Dockerfile.ppc64le fixes for opencv-python and hf-xet (#16048) · 6bf27aff
  Md. Shafi Hussain authored Apr 14, 2025
```
Signed-off-by: Md. Shafi Hussain <Md.Shafi.Hussain@ibm.com>
```
  6bf27aff