Commits · 86a1f67a3b63977b55bf5ef2e550893d7750bfa0 · OpenDAS / vllm_cscc · GitLab

01 May, 2025 17 commits
- [Bugfix][Benchmarks] Allow benchmark of deepspeed-mii backend to select a model (#17285) · 86a1f67a
  Teruaki Ishizaki authored May 01, 2025
```
Signed-off-by: Teruaki Ishizaki <teruaki.ishizaki@ntt.com>
```
  86a1f67a
- Improve configs - `ObservabilityConfig` (#17453) · a257d9bc
  Harry Mellor authored May 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a257d9bc
- [Misc] Optimize the Qwen3_ReasoningParser extract_reasoning_content (#17515) · 015069b0
  Chauncey authored May 01, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  015069b0
- [Core] Enable IPv6 with vllm.utils.make_zmq_socket() (#16506) · fbefc8a7
  Russell Bryant authored May 01, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  fbefc8a7
- Avoid overwriting vllm_compile_cache.py (#17418) · 26bc4bbc
  Keyun Tong authored May 01, 2025
```
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
```
  26bc4bbc
- [BugFix] Fix mla cpu - missing 3 required positional arguments (#17494) · 3c3d7672
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  3c3d7672
- [BugFix] fix speculative decoding memory leak when speculation is disabled (#15506) · 13cf6b62
  Noah Yoshida authored Apr 30, 2025
```
Signed-off-by: Noah Yoshida <noahcy117@gmail.com>
```
  13cf6b62
- [ROCm] Effort to reduce the number of environment variables in command line (#17229) · 90d0a54c
  Hongxia Yang authored May 01, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  90d0a54c
- [Build] Require setuptools >= 77.0.3 for PEP 639 (#17389) · 7a0a146c
  Russell Bryant authored May 01, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7a0a146c
- FIxing the AMD test failures caused by PR#16457 (#17511) · 7ab643e4
  Alexei-V-Ivanov-AMD authored May 01, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  7ab643e4
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
- [CI][Bugfix] Fix failing V1 Test due to missing 'cache_salt' arg (#17500) · aa4502e7
  Michael Goin authored Apr 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  aa4502e7
- [CI][TPU] Skip structured outputs+spec decode tests on TPU (#17510) · 17b4d85f
  Michael Goin authored Apr 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  17b4d85f
- [Bugfix] Temporarily disable gptq_bitblas on ROCm (#17411) · 1144a8ef
  NaLan ZeYu authored May 01, 2025
```
Signed-off-by: Yan Cangang <nalanzeyu@gmail.com>
```
  1144a8ef
- [Bugfix][ROCm] Fix import error on ROCm (#17495) · 08fb5587
  Gregory Shtrasberg authored Apr 30, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  08fb5587
- [CI][TPU] Skip Multimodal test (#17488) · dbc18e78
  Siyuan Liu authored Apr 30, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  dbc18e78
- [Misc] Rename Audios -> Audio in Qwen2audio Processing (#17507) · 02bd6548
  Alex Brooks authored Apr 30, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  02bd6548
30 Apr, 2025 23 commits
- Bump Compressed Tensors version to 0.9.4 (#17478) · 200bbf92
  Rahul Tuli authored Apr 30, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  200bbf92
- [v1][Spec Decode] Make sliding window compatible with eagle prefix caching (#17398) · 81ecf425
  Chen Zhang authored May 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  81ecf425
- doc: fix bug report Github template formatting (#17486) · 42d9a2c4
  David Xia authored Apr 30, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  42d9a2c4
- [doc] add install tips (#17373) · 2ac74d09
  Reid authored May 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2ac74d09
- [Bugfix][ROCm] Restrict ray version due to a breaking release (#17480) · 584f5fb4
  Gregory Shtrasberg authored Apr 30, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  584f5fb4
- [BugFix] Fix authorization of openai_transcription_client.py (#17321) · d586ddc6
  zh Wang authored May 01, 2025
```
Signed-off-by: zh Wang <rekind133@outlook.com>
```
  d586ddc6
- [Docs] Update optimization.md doc (#17482) · 0b7e701d
  Michael Goin authored Apr 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0b7e701d
- [V1] Allow turning off pickle fallback in vllm.v1.serial_utils (#17427) · 947f2f53
  Russell Bryant authored Apr 30, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  947f2f53
- [Bugfix] Fixed mistral tokenizer path when pointing to file (#17457) · 739e03b3
  Pete Savage authored Apr 30, 2025
```
Signed-off-by: Pete Savage <psavage@redhat.com>
```
  739e03b3
- [Fix] Support passing args to logger (#17425) · da4e7687
  Aaron Pham authored Apr 30, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  da4e7687
- [Docs] Add command for running mypy tests from CI (#17475) · 39317cf4
  Russell Bryant authored Apr 30, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  39317cf4
- [Feature] The Qwen3 reasoning parser supports guided decoding (#17466) · 2990cee9
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2990cee9
- [V1][Metrics] add support for kv event publishing (#16750) · 0be6d05b
  Alec authored Apr 30, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  0be6d05b
- [Core] Prevent side-channel attacks via cache salting (#17045) · 77073c77
  Marko Rosenmueller authored Apr 30, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  77073c77
- [TPU][V1][CI] Update regression test baseline for v6 CI (#17064) · a7d5b016
  Nicolò Lucchesi authored Apr 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a7d5b016
- [V1][Bugfix]: vllm v1 verison metric num_gpu_blocks is None (#15755) · d8037867
  rongfu.leng authored Apr 30, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  d8037867
- [Misc] Remove deprecated files (#17447) · 1534d389
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  1534d389
- Make the _apply_rotary_emb compatible with dynamo (#17435) · ece5a8b0
  Lu Fang authored Apr 30, 2025
  
  ece5a8b0
- [MODEL ADDITION] Ovis2 Model Addition (#15826) · 54072f31
  Marco authored Apr 30, 2025
```
Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  54072f31
- [Bugfix] Fix AttributeError: 'State' object has no attribute 'engine_client' (#17434) · be633fba
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  be633fba
- [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) · ed6cfb90
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  ed6cfb90
- [Intel GPU] [CI]Fix XPU ci, setuptools >=80.0 have build issue (#17298) · 6ed9f604
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6ed9f604
- Support LoRA for Mistral3 (#17428) · a44c4f1d
  Michael Goin authored Apr 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a44c4f1d