Commits · 4ce42f92042ef8a24e925fc7121f7c98e51f73ba · OpenDAS / vllm_cscc

23 May, 2025 4 commits
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- Use prebuilt FlashInfer x86_64 PyTorch 2.7 CUDA 12.8 wheel for CI (#18537) · 1645b601
  Huy Do authored May 23, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  1645b601
- [Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to... · 7ab056c2
  Kay Yan authored May 23, 2025
```
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to `requirements/cpu.txt`  (#18542)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  7ab056c2
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
22 May, 2025 2 commits

[Build/CI] Fix CUDA 11.8 build (#17679) · 6e588da0

Tyler Michael Smith authored May 22, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

6e588da0

[Neuron] Update Dockerfile.neuron to use latest neuron release (2.23) (#18512) · e2d7d312
Satyajith Chilappagari authored May 22, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
e2d7d312

21 May, 2025 2 commits
- [FEAT][ROCm] Upgrade AITER MLA v1 backend (#18338) · 94d8ec8d
  vllmellm authored May 22, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  94d8ec8d
- [Build] fix Dockerfile shell (#18402) · 371376f9
  Kebe authored May 21, 2025
  
  371376f9
20 May, 2025 1 commit
- fix:Build torch wheel inline rather than picking from nightly (#18351) · 23baa218
  Dilip Gowda Bhagavan authored May 21, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  23baa218
19 May, 2025 1 commit
- [Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) · 47fda6d0
  Simon Mo authored May 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  47fda6d0
17 May, 2025 2 commits
- Fixed build on ppc64le due to openssl conflicts (#18262) · f880d425
  Nishidha authored May 17, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  f880d425
- Update Dockerfile to build for Blackwell (#18095) · dcfe9523
  Michael Goin authored May 17, 2025
  
  dcfe9523
16 May, 2025 1 commit
- [Sampler] Adapt to FlashInfer 0.2.3 sampler API (#15777) · 7fdfa015
  Bowen Wang authored May 16, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7fdfa015
09 May, 2025 1 commit

[FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6

vllmellm authored May 09, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

3c9396a6

07 May, 2025 1 commit
- Add logging for torch nightly version (#17669) · 6de3e134
  Yang Wang authored May 06, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  6de3e134
01 May, 2025 2 commits
- [ROCm] Effort to reduce the number of environment variables in command line (#17229) · 90d0a54c
  Hongxia Yang authored May 01, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  90d0a54c
- FIxing the AMD test failures caused by PR#16457 (#17511) · 7ab643e4
  Alexei-V-Ivanov-AMD authored May 01, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  7ab643e4
30 Apr, 2025 2 commits
- [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) · ed6cfb90
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  ed6cfb90
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
29 Apr, 2025 3 commits
- Fix: Python package installation for opentelmetry (#17049) · c9c1b59e
  Dilip Gowda Bhagavan authored Apr 30, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  c9c1b59e
- [CI/Build] Add retry mechanism for add-apt-repository (#17107) · 08e15def
  Reid authored Apr 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  08e15def
- [TPU][V1][CI] Replace `python3 setup.py develop` with standard `pip install --e` on TPU (#17374) · 792595b5
  Nicolò Lucchesi authored Apr 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  792595b5
28 Apr, 2025 1 commit
- [Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261) · d1aeea75
  Lennart K. M. Schulz authored Apr 28, 2025
```
Signed-off-by: lkm-schulz <44176356+lkm-schulz@users.noreply.github.com>
```
  d1aeea75
23 Apr, 2025 2 commits
- [CI/Build] workaround for CI build failure (#17070) · b07d7416
  Sangyeon Cho authored Apr 24, 2025
```
Signed-off-by: csy1204 <josang1204@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b07d7416
- add Dockerfile build vllm against torch nightly (#16936) · f67e9e9f
  Yang Wang authored Apr 22, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  f67e9e9f
22 Apr, 2025 2 commits

[FEAT][ROCm] Integrate Paged Attention Kernel from AITER (#15001) · 0e237f00

vllmellm authored Apr 22, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

0e237f00

[ROCm] Add aiter tkw1 kernel for Llama4 fp8 (#16727) · 5b794cae

kliuae authored Apr 22, 2025


Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

5b794cae

18 Apr, 2025 1 commit
- [Misc] add collect_env to cli and docker image (#16759) · 7bdfd29a
  rongfu.leng authored Apr 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  7bdfd29a
16 Apr, 2025 1 commit
- [Bugfix] fix gpu docker image mis benchmarks dir (#16628) · 96bb8aa6
  rongfu.leng authored Apr 16, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  96bb8aa6
14 Apr, 2025 2 commits
- s390x: Fix PyArrow build and add CPU test script for Buildkite CI (#16036) · 7b5ecf79
  Nishan Acharya authored Apr 14, 2025
```
Signed-off-by: Nishan Acharya <Nishan.Acharya@ibm.com>
```
  7b5ecf79
- [fix]: Dockerfile.ppc64le fixes for opencv-python and hf-xet (#16048) · 6bf27aff
  Md. Shafi Hussain authored Apr 14, 2025
```
Signed-off-by: Md. Shafi Hussain <Md.Shafi.Hussain@ibm.com>
```
  6bf27aff
11 Apr, 2025 1 commit
- [CPU][Bugfix] Fix CPU docker issues (#16454) · dda81102
  Li, Jiang authored Apr 11, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  dda81102
09 Apr, 2025 1 commit
- [CI]Fix hpu docker and numpy version for CI (#16355) · 566f10a9
  Chendi.Xue authored Apr 09, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  566f10a9
08 Apr, 2025 1 commit
- Update BASE_IMAGE to 2.22 release of Neuron (#16218) · 1d012112
  Satyajith Chilappagari authored Apr 07, 2025
  
  1d012112
02 Apr, 2025 1 commit
- Restricted cmake to be less than version 4 as 4.x breaks the build of… (#15859) · 8bd651b3
  Nishidha authored Apr 02, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  8bd651b3
01 Apr, 2025 1 commit
- [ROCm][Build][Bugfix] Bring the base dockerfile in sync with the ROCm fork (#15820) · a57a3044
  Gregory Shtrasberg authored Apr 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a57a3044
31 Mar, 2025 1 commit
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e