Commits · d8037867313eef09779b265ea4bace76d2d118ba · OpenDAS / vllm_cscc · GitLab

30 Apr, 2025 15 commits
- [V1][Bugfix]: vllm v1 verison metric num_gpu_blocks is None (#15755) · d8037867
  rongfu.leng authored Apr 30, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  d8037867
- [Misc] Remove deprecated files (#17447) · 1534d389
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  1534d389
- Make the _apply_rotary_emb compatible with dynamo (#17435) · ece5a8b0
  Lu Fang authored Apr 30, 2025
  
  ece5a8b0
- [MODEL ADDITION] Ovis2 Model Addition (#15826) · 54072f31
  Marco authored Apr 30, 2025
```
Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  54072f31
- [Bugfix] Fix AttributeError: 'State' object has no attribute 'engine_client' (#17434) · be633fba
  Chauncey authored Apr 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  be633fba
- [Hardware][Intel GPU] Upgrade to torch 2.7 (#17444) · ed6cfb90
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  ed6cfb90
- [Intel GPU] [CI]Fix XPU ci, setuptools >=80.0 have build issue (#17298) · 6ed9f604
  Kunshang Ji authored Apr 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6ed9f604
- Support LoRA for Mistral3 (#17428) · a44c4f1d
  Michael Goin authored Apr 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a44c4f1d
- Fix some speculative decode tests with tl.dot (#17371) · 88fcf00d
  Huy Do authored Apr 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  88fcf00d
- Fix call to `logger.info_once` (#17416) · d1f569b1
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d1f569b1
- Improve configs - `ModelConfig` (#17130) · 13698db6
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13698db6
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
- Truncation control for embedding models (#14776) · 1c2bc7ea
  Gabriel Marinho authored Apr 29, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1c2bc7ea
- [release] Always git fetch all to get latest tag on TPU release (#17322) · 4055130a
  Kevin H. Luu authored Apr 29, 2025
  
  4055130a
- [V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702) · 34120f5a
  Benjamin Chislett authored Apr 29, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  34120f5a
29 Apr, 2025 25 commits
- Remove Bamba 9B from CI (#17407) · 7489ec0b
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7489ec0b
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
- Fix: Python package installation for opentelmetry (#17049) · c9c1b59e
  Dilip Gowda Bhagavan authored Apr 30, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  c9c1b59e
- Remove Falcon3 2x7B from CI (#17404) · 0350809f
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0350809f
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
- [CI/Build] Add retry mechanism for add-apt-repository (#17107) · 08e15def
  Reid authored Apr 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  08e15def
- [CI] Uses Python 3.11 for TPU (#17359) · b37685af
  Aaron Pham authored Apr 29, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  b37685af
- [TPU][V1][CI] Replace `python3 setup.py develop` with standard `pip install --e` on TPU (#17374) · 792595b5
  Nicolò Lucchesi authored Apr 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  792595b5
- [Doc][Typo] Fixing label in new model requests link in overview.md (#17400) · 0c1c7883
  casinca authored Apr 29, 2025
  
  0c1c7883
- [Docs] Propose a deprecation policy for the project (#17063) · 56d64fbe
  Russell Bryant authored Apr 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  56d64fbe
- Enabling multi-group kernel tests. (#17115) · 608968b7
  Alexei-V-Ivanov-AMD authored Apr 29, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  608968b7
- [Misc][ROCm] Exclude `cutlass_mla_decode` for ROCm build (#17289) · 06ffc7e1
  TY-AMD authored Apr 30, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  06ffc7e1
- fix gemma3 results all zero (#17364) · d3cf61b8
  Qiming Zhang authored Apr 29, 2025
```
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
```
  d3cf61b8
- [Bugfix] add qwen3 reasoning-parser fix content is None when disable … (#17369) · a39203f9
  mofanke authored Apr 30, 2025
```
Signed-off-by: mofanke <mofanke@gmail.com>
```
  a39203f9
- [V1] Remove num_input_tokens from attn_metadata (#17193) · 24e6ad3f
  Chen Zhang authored Apr 30, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  24e6ad3f
- Improve literal dataclass field conversion to argparse argument (#17391) · 2ef5d106
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2ef5d106
- Fix: Spelling of inference (#17387) · 0ed27ef6
  a2q1p authored Apr 30, 2025
  
  0ed27ef6
- Transformers backend tweaks (#17365) · 900edfa8
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  900edfa8
- [Frontend] Support `chat_template_kwargs` in `LLM.chat` (#17356) · 88ad9ec6
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  88ad9ec6
- `pre-commit autoupdate` (#17380) · 40896bdf
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  40896bdf
- [Bugfix] Clean up MiniMax-VL and fix processing (#17354) · 00ee37ef
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00ee37ef
- [Doc] Fix QWen3MOE info (#17381) · 890f104c
  Jee Jee Li authored Apr 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  890f104c
- Update docs requirements (#17379) · 4a5e1314
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4a5e1314
- [Model] Ignore rotary embed load for Cohere model (#17319) · 97cc8729
  Ekagra Ranjan authored Apr 29, 2025
  
  97cc8729