Commits · d328f7894f140fdc643dc1aa5fe80f4596e6f418 · OpenDAS / vllm_cscc

"examples/basic/offline_inference/embed.py" did not exist on "99f536f83093dc22e4220b5bd0f8c63f9e86a406"

02 Sep, 2025 7 commits
- [CI] Enable all hf transformers baselines in test_hybrid (#23936) · d328f789
  Thomas Parnell authored Sep 02, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  d328f789
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- Run ruff format on a few files. (#24075) · f399182e
  Chenheli Hua authored Sep 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  f399182e
- [CI Failure] Skip failing nvfp4 silu test (#23959) · e66ed3e6
  Michael Goin authored Sep 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e66ed3e6
- [CI]: reduce HTTP calls inside entrypoints openai tests (#23646) · ce30dca5
  Aziz authored Sep 02, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ce30dca5
- [Doc]: fix typos in Python comments (#24077) · fad73be1
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fad73be1
- [V1][Mamba1] - FP32 SSM Kernel Support (#23506) · 2b41cbbf
  Asaf Joseph Gardin authored Sep 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  2b41cbbf
01 Sep, 2025 7 commits

[Model] Support DP for ViT on Kimi-VL-A3B-Thinking-2506 (#23817) · a0e0efd6

WeiQing Chen authored Sep 02, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

a0e0efd6

[docs][misc] IOProcessor plugins fixes (#24046) · cf91a89d
Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
cf91a89d

[Model]: support KeyeVL-1_5-8B (#23838) · 7c8271cd

Kwai-Keye authored Sep 01, 2025


Signed-off-by: wangruitao <wangruitao@kuaishou.com>
Co-authored-by: wangruitao <wangruitao@kuaishou.com>

7c8271cd

[Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735) · d46934b2
Nicolò Lucchesi authored Sep 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
d46934b2
[Bugfix] Add support for `<tool_call>` format in streaming mode for XLAM Tool Parser (#22769) · 422e793f
Code Jesus authored Aug 31, 2025
```
Signed-off-by: Devon Peroutky <devon@kindo.ai>
```
422e793f

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

[CI/Build] Improve Tensor Schema tests speed by avoid engine core initialization (#23357) · ff0e59d8
Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
ff0e59d8

31 Aug, 2025 1 commit
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 4 commits
- [UT] fix unify_kv_cache_configs when kv cache config needs sort (#23843) · 5490d633
  Ning Xie authored Aug 30, 2025
  
  5490d633
- [Bugfix] Fix test_lora_resolvers.py (#23984) · 628d00cd
  Jee Jee Li authored Aug 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  628d00cd
- [CI] Move testing image from remote URL to S3 (#23980) · ee52a327
  Roger Wang authored Aug 29, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  ee52a327
- [Bugfix] Fix --config arg expansion called from api_server.py (#23944) · 5b31cb17
  dubejf authored Aug 30, 2025
```
Signed-off-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  5b31cb17
29 Aug, 2025 14 commits
- [CI] Fix unavailable image remote URL (#23966) · d660c98c
  Roger Wang authored Aug 29, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d660c98c
- Revert gemma3n fast prefill changes (#23897) · 8c3e1999
  Yong Hoon Shin authored Aug 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8c3e1999
- [RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) · 4d7fe40f
  22quinn authored Aug 29, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4d7fe40f
- [BugFix] Async scheduling and PP compatibility with DP (#23770) · d90d8eb6
  Nick Hill authored Aug 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d90d8eb6
- [MODEL] `Apertus` and `XIELU` (#23068) · 1cf3753b
  EduardDurech authored Aug 29, 2025
```
Signed-off-by: EduardDurech <39579228+EduardDurech@users.noreply.github.com>
Co-authored-by: AllenHaoHuang <allenhuangdd@gmail.com>
```
  1cf3753b
- Adds `json_count_leaves` utility function (#23899) · 4f7cde72
  Adit Chawdhary authored Aug 29, 2025
```
Signed-off-by: aditchawdhary <aditxy@hotmail.com>
```
  4f7cde72
- Update PyTorch to 2.8.0 (#20358) · 67c14906
  Huy Do authored Aug 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  67c14906
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
- [Performance] V1 Classify Models E2E Performance Optimization (#23541) · d9e00dbd
  wang.yuqi authored Aug 29, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d9e00dbd
- [V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b
  Maximilien de Bayser authored Aug 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2554b27b
- [CI/Build] Clean up LoRA test (#23890) · b4f9e963
  Jee Jee Li authored Aug 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b4f9e963
- [Bugfix] Use `ReplicatedLinear` for SequenceClassification head (#23836) · 98ac0cb3
  Isotr0py authored Aug 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  98ac0cb3
- [tests] Improve speed and reliability of test_transcription_api_correctness (#23854) · c8b3b299
  Russell Bryant authored Aug 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c8b3b299
- [V0 Deprecation] Remove V0 Samplers test (#23862) · b668055a
  Woosuk Kwon authored Aug 28, 2025
  
  b668055a
28 Aug, 2025 7 commits
- [V1] Enable prefill optimization for Gemma3n (#22628) · cb293f6a
  Yong Hoon Shin authored Aug 28, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  cb293f6a
- [NVIDIA] Support SiluMul + NVFP4 quant fusion (#23671) · 16a45b3a
  elvischenv authored Aug 29, 2025
```
Signed-off-by: jindih <jindih@nvidia.com>
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: jindih <jindih@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedic <lgovedic@redhat.com>
```
  16a45b3a
- [New Model]: Support GteNewModelForSequenceClassification (#23524) · 11a7fafa
  wang.yuqi authored Aug 28, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  11a7fafa
- [Kernel] cuda kernels for upcoming decode context parallel feature (#23791) · 186aced5
  yzds authored Aug 28, 2025
```
Co-authored-by: hongchao <hongchao@msh.team>
```
  186aced5
- [CI] enable idefics3 and fuyu-8b test in multimodal test (#23790) · c07a7331
  Jiangyun Zhu authored Aug 28, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c07a7331
- [Transform] [Quantization] Add transforms to compressed tensors (#22486) · 22feac8e
  Kyle Sayers authored Aug 28, 2025
  
  22feac8e
- [Bugfix] Fix for V1 priority scheduling crashes at preemption (#23713) · 5da4f5d8
  Hanchenli authored Aug 27, 2025
```
Signed-off-by: Hanchenli <lihanc2002@gmail.com>
```
  5da4f5d8