Commits · 42d9a2c4c70232204c799794be43164d19233fa1 · OpenDAS / vllm_cscc · GitLab

30 Apr, 2025 28 commits
- doc: fix bug report Github template formatting (#17486) · 42d9a2c4
  David Xia authored Apr 30, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  42d9a2c4
- [doc] add install tips (#17373) · 2ac74d09
  Reid authored May 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2ac74d09
- [Bugfix][ROCm] Restrict ray version due to a breaking release (#17480) · 584f5fb4
  Gregory Shtrasberg authored Apr 30, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  584f5fb4
- [BugFix] Fix authorization of openai_transcription_client.py (#17321) · d586ddc6
  zh Wang authored May 01, 2025
```
Signed-off-by: zh Wang <rekind133@outlook.com>
```
  d586ddc6
- [Docs] Update optimization.md doc (#17482) · 0b7e701d
  Michael Goin authored Apr 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0b7e701d
- [V1] Allow turning off pickle fallback in vllm.v1.serial_utils (#17427) · 947f2f53
  Russell Bryant authored Apr 30, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  947f2f53
- [Bugfix] Fixed mistral tokenizer path when pointing to file (#17457) · 739e03b3
  Pete Savage authored Apr 30, 2025
```
Signed-off-by: Pete Savage <psavage@redhat.com>
```
  739e03b3
- [Fix] Support passing args to logger (#17425) · da4e7687
  Aaron Pham authored Apr 30, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  da4e7687
- [Docs] Add command for running mypy tests from CI (#17475) · 39317cf4
  Russell Bryant authored Apr 30, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  39317cf4
- [Feature] The Qwen3 reasoning parser supports guided decoding (#17466) · 2990cee9
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2990cee9
- [V1][Metrics] add support for kv event publishing (#16750) · 0be6d05b
  Alec authored Apr 30, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  0be6d05b
- [Core] Prevent side-channel attacks via cache salting (#17045) · 77073c77
  Marko Rosenmueller authored Apr 30, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  77073c77
- [TPU][V1][CI] Update regression test baseline for v6 CI (#17064) · a7d5b016
  Nicolò Lucchesi authored Apr 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a7d5b016
- [V1][Bugfix]: vllm v1 verison metric num_gpu_blocks is None (#15755) · d8037867
  rongfu.leng authored Apr 30, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  d8037867
- [Misc] Remove deprecated files (#17447) · 1534d389
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  1534d389
- Make the _apply_rotary_emb compatible with dynamo (#17435) · ece5a8b0
  Lu Fang authored Apr 30, 2025
  
  ece5a8b0
- [MODEL ADDITION] Ovis2 Model Addition (#15826) · 54072f31
  Marco authored Apr 30, 2025
```
Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  54072f31
- [Bugfix] Fix AttributeError: 'State' object has no attribute 'engine_client' (#17434) · be633fba
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  be633fba
- [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) · ed6cfb90
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  ed6cfb90
- [Intel GPU] [CI]Fix XPU ci, setuptools >=80.0 have build issue (#17298) · 6ed9f604
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6ed9f604
- Support LoRA for Mistral3 (#17428) · a44c4f1d
  Michael Goin authored Apr 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a44c4f1d
- Fix some speculative decode tests with tl.dot (#17371) · 88fcf00d
  Huy Do authored Apr 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  88fcf00d
- Fix call to `logger.info_once` (#17416) · d1f569b1
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d1f569b1
- Improve configs - `ModelConfig` (#17130) · 13698db6
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13698db6
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
- Truncation control for embedding models (#14776) · 1c2bc7ea
  Gabriel Marinho authored Apr 29, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1c2bc7ea
- [release] Always git fetch all to get latest tag on TPU release (#17322) · 4055130a
  Kevin H. Luu authored Apr 29, 2025
  
  4055130a
- [V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702) · 34120f5a
  Benjamin Chislett authored Apr 29, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  34120f5a
29 Apr, 2025 12 commits
- Remove Bamba 9B from CI (#17407) · 7489ec0b
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7489ec0b
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
- Fix: Python package installation for opentelmetry (#17049) · c9c1b59e
  Dilip Gowda Bhagavan authored Apr 30, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  c9c1b59e
- Remove Falcon3 2x7B from CI (#17404) · 0350809f
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0350809f
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
- [CI/Build] Add retry mechanism for add-apt-repository (#17107) · 08e15def
  Reid authored Apr 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  08e15def
- [CI] Uses Python 3.11 for TPU (#17359) · b37685af
  Aaron Pham authored Apr 29, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  b37685af
- [TPU][V1][CI] Replace `python3 setup.py develop` with standard `pip install --e` on TPU (#17374) · 792595b5
  Nicolò Lucchesi authored Apr 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  792595b5
- [Doc][Typo] Fixing label in new model requests link in overview.md (#17400) · 0c1c7883
  casinca authored Apr 29, 2025
  
  0c1c7883
- [Docs] Propose a deprecation policy for the project (#17063) · 56d64fbe
  Russell Bryant authored Apr 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  56d64fbe
- Enabling multi-group kernel tests. (#17115) · 608968b7
  Alexei-V-Ivanov-AMD authored Apr 29, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  608968b7