Commits · 5afb387bd43cef01d68119d017587e689b0729fa · OpenDAS / vllm_cscc · GitLab

06 Mar, 2026 19 commits
- Change "following fields were present in the request but ignored" log from warn to debug (#36173) · 5afb387b
  Tyler Michael Smith authored Mar 06, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  5afb387b
- [BugFix] avoid infinite loop with VLLM_PORT and get_open_ports_list (#36191) · 43e77e59
  Walter Beller-Morales authored Mar 06, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  43e77e59
- [Security] Respect user trust_remote_code setting in NemotronVL and KimiK25 (#36192) · 00bd08ed
  Russell Bryant authored Mar 06, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  00bd08ed
- [Bugfix] Fix misleading context length error messages (#36197) · 43f10573
  Ajay Anubolu authored Mar 05, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  43f10573
- [Bugfix] Fix inner_dp_world initialization order for multi-node TP (#35892) · 86e1060b
  Yongye Zhu authored Mar 06, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  86e1060b
- [Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
  Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  27066d1b
- perf: add __slots__ to KVCacheBlock (#36164) · 57c84ff1
  cong-or authored Mar 06, 2026
```
Signed-off-by: cong-or <conchubhar.gannon@gmail.com>
```
  57c84ff1
- docs: fix wrong cc in int8.md (#36209) · e68de8ad
  Xiang Shi authored Mar 06, 2026
```
Signed-off-by: Xiang Shi <realkevin@tutanota.com>
```
  e68de8ad
- [CI] Fix bge-m3 similarity reference values after *Defination* typo fix (#36208) · a1ffa56a
  Andreas Karatzas authored Mar 05, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a1ffa56a
- [BugFix] Fix engine hanging after KV cache initialization failure (#35478) · 0a208d1f
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  0a208d1f
- [Feature] Add --distributed-timeout-seconds CLI option (#36047) · 03a49bb8
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  03a49bb8
- [Bug] Fix a corner case in _process_simple_streaming_events (#34754) · 8e87cc57
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  8e87cc57
- [Misc] Rename `group_mm_kwargs_by_modality -> group_and_batch_mm_kwargs` (#36158) · 6dd30265
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6dd30265
- [Bugfix] Fix simple Mistral-Small example (#36156) · de00ebea
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  de00ebea
- [ROCm][CI] Adding missing dependencies for Multi-modal models tests (#36177) · 639680d2
  Andreas Karatzas authored Mar 05, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  639680d2
- Reenable features for ROCm attention backends (#36185) · c5362c73
  Rohan Potdar authored Mar 05, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  c5362c73
- cpu: aarch64: Upgrade OneDNN for aarch64 to add support for int8 matmul (#36147) · 0a49676f
  Nikhil Gupta authored Mar 06, 2026
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
  0a49676f
- Don't fire ray compatibility webhook when PR or branch is not provided (#36088) · c012a8c4
  Jeffrey Wang authored Mar 05, 2026
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  c012a8c4
- [Performance] Extract KV-cache update from TreeAttention backend (#35384) · ebed80a7
  Dor Huri authored Mar 06, 2026
```
Signed-off-by: dorhuri123 <dor.huri1@live.biu.ac.il>
```
  ebed80a7
05 Mar, 2026 21 commits
- [Model Runner V2] Fix warmup for very small kvcache and/or blocksizes (#36176) · a73af584
  Nick Hill authored Mar 05, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a73af584
- [compile] Consistent compiler config for saved/loaded vllm backends. (#35810) · a97954b6
  Zhengxu Chen authored Mar 05, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  a97954b6
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd
- [CI] Add explicit permissions to macOS smoke test workflow (#35775) · 5395471d
  Russell Bryant authored Mar 05, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  5395471d
- [BugFix] Fallback from FA4->FA2 for Batch Invariance (#36059) · a57c877f
  Frank Wang authored Mar 05, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
```
  a57c877f
- [Perf] Optimize FusedMoEModularKernel output tensor using torch.empty (#35794) · f9170209
  Xin Yang authored Mar 05, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  f9170209
- [Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE (#36146) · 86483ca7
  tomeras91 authored Mar 05, 2026
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  86483ca7
- ParakeetProjection.norm = RMSNorm instead of nn.LayerNorm (#36133) · b93a9e6f
  Netanel Haber authored Mar 05, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  b93a9e6f
- [XPU] Enable ModelRunnerV2 on XPU (#36078) · d8839ef7
  Xinyu Chen authored Mar 06, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  d8839ef7
- [BUGFIX]Fix Qwen-Omni models audio max_token_per_item estimation error leading... · e998fa76
  Avery Miao authored Mar 06, 2026
```
[BUGFIX]Fix Qwen-Omni models audio max_token_per_item estimation error leading to encoder_cache_size is 0 (#35994)
Signed-off-by: Miao, Avery <avery.miao@intel.com>
```
  e998fa76
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
  Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8c760b6a
- refactor funasr model. (#36108) · 3ee68590
  AllenDou authored Mar 06, 2026
```
Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3ee68590
- [Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  71963481
- [openai api] log exception in exception handler (1/N) (#31164) · 176c799f
  Ning Xie authored Mar 06, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  176c799f
- [KVConnector] Scheduler: Fix num_computed_tokens after async KV load (#34616) · 612e7729
  Or Ozeri authored Mar 05, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  612e7729
- Fix import that was moved in Transformers 5.2.0 (#36120) · ecde7af9
  Harry Mellor authored Mar 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ecde7af9
- [Docs] Only build docs if `documentation` or `ready` labels are present (#36135) · 8df52335
  Harry Mellor authored Mar 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8df52335
- [CI] Stabilize test_no_args_tool_call and add ROCm-specific server args (#36107) · b03ff6a9
  Andreas Karatzas authored Mar 05, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  b03ff6a9
- [Bugfix] Fix RunAI streamer crash with S3-hosted model paths (#35976) · ed81d5ed
  Ajay Anubolu authored Mar 05, 2026
```
Signed-off-by: AjAnubolu <anuboluajay@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ed81d5ed
- [Bugfix] Fix mypy errors in hermes_tool_parser.py (#36114) · 3c23ac84
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  3c23ac84