Commits · 39971db3aaa339a1983582422c449ba5c2ed6e46 · OpenDAS / vllm_cscc

25 Aug, 2025 1 commit

Frontend: Adding LM Format Enforcer support to V1 engine (#22564) · 39971db3

Noam Gat authored Aug 25, 2025


Signed-off-by: Noam Gat <noamgat@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39971db3

23 Aug, 2025 1 commit

Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d

Daifeng Li authored Aug 23, 2025


Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

fa78de9d

22 Aug, 2025 3 commits
- [Bugfix]: Installing dev environment due to pydantic incompatible version (#23353) · 613a23b5
  Martin Hickey authored Aug 22, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  613a23b5
- [Fix] Bump triton version in rocm-build requirements (#21630) · 51a21530
  Burkhard Ringlein authored Aug 22, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
```
  51a21530
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
20 Aug, 2025 1 commit

[Quantization] Bump Compressed Tensors Version (#23202) · c32e6ad1

Kyle Sayers authored Aug 19, 2025


Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

c32e6ad1

19 Aug, 2025 2 commits
- [CI/Build] Update transformers to v4.55.2 (#23093) · d6a1a209
  Isotr0py authored Aug 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d6a1a209
- [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) · 78dba404
  Nikhil Suryawanshi authored Aug 19, 2025
```
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
```
  78dba404
18 Aug, 2025 3 commits

Install tpu_info==0.4.0 to fix core dump for TPU (#23135) · 498259cc
Xiang Xu authored Aug 18, 2025

498259cc

fix: OpenAI SDK compat (ResponseTextConfig) (#23126) · ac6eb49d

Breno Baldas Skuk authored Aug 19, 2025


Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
Signed-off-by: Breno Baldas Skuk <breno.skuk@hcompany.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

ac6eb49d

[CI Bugfix] Pin `openai<1.100` to unblock CI (#23118) · bf756321
Michael Goin authored Aug 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
bf756321

11 Aug, 2025 1 commit
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
09 Aug, 2025 3 commits

[Model] Gemma3n MM (#20495) · 5a16fa61

Nicolò Lucchesi authored Aug 09, 2025


Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

5a16fa61

Remove mamba_ssm from vLLM requirements; install inside test container using... · 8a0ffd62

Thomas Parnell authored Aug 09, 2025


Remove mamba_ssm from vLLM requirements; install inside test container using `--no-build-isolation` (#22541)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

8a0ffd62

[XPU] upgrade torch 2.8 on for XPU (#22300) · 81c57f60
Kunshang Ji authored Aug 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
81c57f60

08 Aug, 2025 1 commit
- [Misc] fix openai version (#22485) · 90406390
  rongfu.leng authored Aug 08, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  90406390
07 Aug, 2025 2 commits
- [Docs] Add missing dependency for docs build (#22435) · 434d2f3f
  Harry Mellor authored Aug 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  434d2f3f
- Update `hf_xet` pin to resolve hangs (#22356) · ecbea55c
  Harry Mellor authored Aug 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ecbea55c
06 Aug, 2025 3 commits

[gpt-oss] Add openai-harmony as default dependency (#22332) · 134a8ee8

Woosuk Kwon authored Aug 06, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

134a8ee8

Update transformers to `v4.55` (#21931) · 796bae07

Harry Mellor authored Aug 06, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

796bae07

Increase openai-python version (#22316) · dd16bdc7
Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
dd16bdc7

03 Aug, 2025 1 commit
- [Misc] Bump ray to 2.48.0 (#22123) · 2ff46b88
  Rui Qiao authored Aug 02, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  2ff46b88
01 Aug, 2025 3 commits
- [Misc] Remove upper bound in openai package version (#22060) · 0f81b310
  Woosuk Kwon authored Aug 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0f81b310
- Revert precompile wheel changes (#22055) · da31f6ad
  Simon Mo authored Aug 01, 2025
  
  da31f6ad
- Move flashinfer-python to optional extra `vllm[flashinfer]` (#21959) · 0bd409cf
  Michael Goin authored Jul 31, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0bd409cf
31 Jul, 2025 2 commits
- Update torch_xla pin to 20250730 (#21956) · 53c21e49
  XiongfeiWei authored Jul 31, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  53c21e49
- fix(setup): improve precompiled wheel setup for Docker builds (#22025) · 58bb9021
  Doug Smith authored Jul 31, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  58bb9021
30 Jul, 2025 1 commit
- [Docs] Reduce the size of the built docs (#21920) · 88edf599
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  88edf599
29 Jul, 2025 1 commit
- Add `flashinfer_python` to CUDA wheel requirements (#21389) · a33ea28b
  Michael Goin authored Jul 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a33ea28b
28 Jul, 2025 2 commits
- [Bugfix][CI/Build] Update peft version in test requirement (#21729) · 31084b3b
  Isotr0py authored Jul 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  31084b3b
- [Docs] Add revision date to rendered docs (#21752) · 1395dd9c
  Harry Mellor authored Jul 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1395dd9c
26 Jul, 2025 1 commit
- [TPU] Update ptxla nightly version to 20250724 (#21555) · f1b286b2
  Chengji Yao authored Jul 25, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  f1b286b2
25 Jul, 2025 1 commit
- [CI] Unifying Dockerfiles for ARM and X86 Builds (#21343) · 396ee941
  Kebe authored Jul 25, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  396ee941
24 Jul, 2025 4 commits

[P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849

Juncheng Gu authored Jul 24, 2025


Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>

60662849

[Fix] Update mamba_ssm to 2.2.5 (#21421) · 5a19a6c6
elvischenv authored Jul 24, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
5a19a6c6
[Feat] Allow custom naming of vLLM processes (#21445) · 6da00785
Chauncey authored Jul 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
6da00785
Add think chunk (#21333) · 6d8d0a24
Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
6d8d0a24

23 Jul, 2025 1 commit
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
19 Jul, 2025 1 commit
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
17 Jul, 2025 1 commit
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463