Commits · e68b0dad8b4070e3ae24603c12f53b6c659ba6f9 · OpenDAS / vllm_cscc

"examples/offline_inference/vision_language_multi_image.py" did not exist on "e39ebf5cf5ec8f7449d633b6428333a99a206a1c"

12 Jan, 2026 15 commits
- doc: Update model name for Qwen3-Coder in documentation (#32185) · e68b0dad
  Andy Zhang authored Jan 12, 2026
```
Signed-off-by: Andy Zhang <xiazhang@microsoft.com>
```
  e68b0dad
- OffloadingConnector: Add cpu_bytes_to_use configuration (#24498) · 9cddbdba
  Or Ozeri authored Jan 12, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  9cddbdba
- [Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c
  Hongxin Xu authored Jan 12, 2026
```
Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  49e6b86c
- [P/D] Refactor mooncake connector sender thread using async coroutines (#31573) · 0565f1fd
  dtc authored Jan 12, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  0565f1fd
- [Bugfix] Fix missing scale passing for encoder Triton Attention implementation (#32149) · 9dbe1fe9
  Isotr0py authored Jan 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9dbe1fe9
- [Doc] Add documentation for offline API docs feature (#32134) · a5f89ae2
  RickyChen / 陳昭儒 authored Jan 12, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
```
  a5f89ae2
- [Doc] Improve LoRA docs (#32159) · 05e89812
  Jee Jee Li authored Jan 12, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  05e89812
- [doc] fix broken links (#32158) · 899541bd
  XlKsyt authored Jan 12, 2026
```
Signed-off-by: minimAluminiumalism <caixuesen@outlook.com>
```
  899541bd
- [Frontend] Fix Flaky MCP Streaming Test (#32153) · d7b2e570
  daniel-salib authored Jan 12, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  d7b2e570
- [cpu][bench] Add Fused MoE Micro Benchmark for CPU Backend (#32092) · 5e034f2e
  Andika Rachman authored Jan 12, 2026
```
Signed-off-by: andikarachman <andika.rachman.y@gmail.com>
```
  5e034f2e
- [Misc] Disable default `--ready-check-timeout-sec` extra call in vllm bench (#30975) · 22970c16
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  22970c16
- [Model] Remove incorrect `SupportsPP` from MTP models (#32150) · 600aaab8
  Cyrus Leung authored Jan 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  600aaab8
- [Model] Improve multimodal pooling examples (#32085) · 60446cd6
  wang.yuqi authored Jan 12, 2026
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  60446cd6
- [Model] Avoid hardcoding pooling type (#32119) · 9101dc75
  Cyrus Leung authored Jan 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9101dc75
- [Model Runner V2] Remove async barrier (#32083) · 025a32f9
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  025a32f9
11 Jan, 2026 13 commits
- [Model Runner V2] Skip building deprecated fields in attn metadata (#32132) · 19504ac0
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19504ac0
- [CI] fix `test_concat_and_cache_mla_rope_fused` (#32117) · 3df619ac
  Jiangyun Zhu authored Jan 11, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3df619ac
- fix offline inference chat response prompt (#32088) · d74132ca
  Ning Xie authored Jan 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d74132ca
- [FixBug] Improve exception string in `tensorizer.py` (#31680) · a34abc49
  maang authored Jan 11, 2026
```
Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a34abc49
- [Misc] fix this log format not space (#32112) · d70249e2
  rongfu.leng authored Jan 11, 2026
```
Signed-off-by: lengrongfu <lenronfu@gmail.com>
```
  d70249e2
- [CI/Build] Separate out flaky responses API tests (#32110) · a3745321
  Cyrus Leung authored Jan 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a3745321
- [Misc] Make `scipy` as optional audio/benchmark dependency (#32096) · cee7436a
  Isotr0py authored Jan 11, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cee7436a
- [KVConnector] OffloadingConnector: Fix bug in handling of preemptions (#29870) · 4c16ba61
  Or Ozeri authored Jan 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c16ba61
- [Hardware][AMD][CI][Bugfix] Fix AMD Quantization test group (#31713) · bde57ab2
  Matt authored Jan 11, 2026
```
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  bde57ab2
- [CPU][BugFix] Disable AOT Compile for CPU (#32037) · 9103ed16
  Fadi Arafeh authored Jan 11, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  9103ed16
- make assume_32_bit_indexing configurable (#32044) · 46eb30f5
  Laith Sakka authored Jan 10, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  46eb30f5
- [MTP][GLM][Bugfix] Fixed .weight_scale loading logic that dropped MTP... · 0dd63639
  Andy Liu authored Jan 10, 2026
```
[MTP][GLM][Bugfix] Fixed .weight_scale loading logic that dropped MTP prediction accuracy with fp8+mtp (#32101)
Signed-off-by: Andy Liu <andyliu@roblox.com>
```
  0dd63639
- [Benchmark][2/2] Use spline interpolation to tune SLA variables (#32095) · ef96fa3f
  Cyrus Leung authored Jan 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef96fa3f
10 Jan, 2026 12 commits
- [BugFix] Wait for compute before offloading KV to CPU (#31341) · 2a4dbe24
  Or Ozeri authored Jan 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  2a4dbe24
- [Bugfix] Fix Qwen3-VL-Reranker model loading for sequence classification (#32089) · 8020a604
  RickyChen / 陳昭儒 authored Jan 11, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8020a604
- [MISC] Add strict contiguity check for FlashInfer attention tensors (#32008) · e15a5ff0
  Vadim Gimpelson authored Jan 11, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
```
  e15a5ff0
- [Bugfix][Quantization] Ensure input contiguity in per_token_quant_int8 (#31637) · 6ea001cf
  Vensen authored Jan 11, 2026
```
Signed-off-by: vensen <vensenmu@gmail.com>
```
  6ea001cf
- Revert "[Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#308… (#31617) · 1c46dea0
  shyeh25 authored Jan 11, 2026
```
Signed-off-by: shyeh25 <206795756+shyeh25@users.noreply.github.com>
```
  1c46dea0
- [BugFix] scheduler: Fix resuming of preempted requests after async load (#31583) · 02859973
  Or Ozeri authored Jan 10, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  02859973
- fused_moe_kernel - cast accumulator after applying router weights (#32002) · d1fd802f
  gnovack authored Jan 10, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  d1fd802f
- [LoRA][Perf] Improve FusedMoE LoRA performance for small rank (#32019) · 543c23be
  Xin Yang authored Jan 10, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  543c23be
- [Kernel] Optimize Sliding Window Attention in 3D Triton Kernel (#31984) · b8bf5c45
  jvlunteren authored Jan 10, 2026
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  b8bf5c45
- [Quant] Support MXFP4 W4A16 for compressed-tensors dense models (#31926) · e6c6f2c7
  Michael Goin authored Jan 10, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e6c6f2c7
- [Bugfix] Fix integer overflow in Gemma3n audio processing (#31657) · 07286ec5
  Jeremy Teboul authored Jan 10, 2026
```
Signed-off-by: Jeremy Teboul <jeremyte@meta.com>
```
  07286ec5
- [Bugfix] fix offline chat output prompt (#32076) · 14fc7a68
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  14fc7a68