Commits · 119c4927b33f78cb8bb2283a57ee0e3a14021777 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "e5e03c2c1b3708640b913a0bcb9b6815f047e7fa"

13 Nov, 2025 38 commits
- [Bugfix] Fix validate model input for decoder models (#27099) · 119c4927
  Yannick Schnider authored Nov 13, 2025
```
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  119c4927
- [Performance][B200] silu_mul_quant: pack scales in int32 (#28358) · fe1cd770
  Varun Sundar Rabindranath authored Nov 13, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fe1cd770
- [TPU] patch TPU wheel build script to resolve metadata issue (#27279) · fdfd5075
  Johnny Yang authored Nov 13, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  fdfd5075
- [BugFix] Ensure `EngineArgs.create_engine_config` is idempotent (#28515) · 327c0a9a
  Nick Hill authored Nov 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  327c0a9a
- Rewrite C++ meta funcs to Python (#28595) · 06c4873d
  Jane (Yuan) Xu authored Nov 13, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
  06c4873d
- [Misc] Turn off encoder torch compile by default (#28634) · d3387750
  Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d3387750
- Fix `get_num_experts` when config sets it explicitly to `None` (#28652) · b230286f
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: bruceszchen <bruceszchen@tencent.com>
```
  b230286f
- [BugFix] DeepSeek-OCR: apply NoRepeatNGramLogitsProcessor to greedy path (#28617) · 3035d1a1
  Yuanping Song authored Nov 13, 2025
```
Signed-off-by: Yuanping Song <yuanping.song@outlook.com>
```
  3035d1a1
- [CI Failure] Fix backend selection for encoder-only models (#28534) · 07a606aa
  Huamin Li authored Nov 13, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  07a606aa
- [CI/Build] Install uv for AMD MI300: Language Models Tests (Hybrid) %N (#28142) · a7791eac
  amdfaa authored Nov 13, 2025
```
Signed-off-by: amdfaa <107946068+amdfaa@users.noreply.github.com>
Signed-off-by: zhewenli <zhewenli@meta.com>
Co-authored-by: zhewenli <zhewenli@meta.com>
```
  a7791eac
- [ROCm][BugFix]Fix `get_cu_count` in rocm_aiter_fa.py (#28618) · 8da2f28f
  Pleaplusone authored Nov 13, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  8da2f28f
- [Hardware][PowerPC] Fix fp16 compilation error for Power in cpu attention... · 86d15bfd
  Akash kaothalkar authored Nov 13, 2025
```
[Hardware][PowerPC] Fix fp16 compilation error for Power in cpu attention backend and bump oneDNN version (#28535)
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  86d15bfd
- [Bugfix] Fix FPS value type for Qwen2.5-Omni video processing (#28630) · c9fe6abe
  Fanli Lin authored Nov 13, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  c9fe6abe
- [XPU] add sym params to IPEXConfig (#28611) · c47b6c85
  zofia authored Nov 13, 2025
```
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
```
  c47b6c85
- Fix io processor pooling #28273 (#28484) · c428e8d8
  baonudesifeizhai authored Nov 13, 2025
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
  c428e8d8
- [BugFix] Fix type error when assign a trition kernel tensor to a torch.nn.Parameter (#28603) · 5e973209
  Zijing Liu authored Nov 13, 2025
```
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
```
  5e973209
- Fix: Correctly filter special tokens in benchmark_prefix_caching (#28615) · e63fd445
  Di Wu authored Nov 13, 2025
```
Signed-off-by: Di Wu <dw2761@nyu.edu>
```
  e63fd445
- Support all interleaved layer types (#28485) · 11ac9ddd
  Yong Hoon Shin authored Nov 12, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  11ac9ddd
- [Frontend] supports interleaved thinking (#28531) · 5c9ad138
  Chauncey authored Nov 13, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5c9ad138
- [Bugfix] fix kimi-linear crash (#28445) · fa183e92
  Jiangyun Zhu authored Nov 13, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  fa183e92
- Add NUMA node validation for CPU thread binding (#28555) · 4ab34f6e
  usberkeley authored Nov 13, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  4ab34f6e
- Use official xformers-0.0.33 built for PT 2.9 (#28600) · c33b87e7
  Huy Do authored Nov 12, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c33b87e7
- [Bugfix] Prevent crash on empty grammar string (#28210) · 4504e802
  tjandy98 authored Nov 13, 2025
```
Signed-off-by: tjandy98 <3953059+tjandy98@users.noreply.github.com>
```
  4504e802
- [ROCm][BugFix] Remove the usage of `device_info` from aiter (#28383) · ca00b1bf
  Pleaplusone authored Nov 13, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  ca00b1bf
- [build][cmake]: Bundle static ACL and torch libgomp for CPU extension builds (#28059) · d44fbbab
  Radu Salavat authored Nov 12, 2025
```
Signed-off-by: Radu Salavat <radu.salavat@arm.com>
```
  d44fbbab
- Support DeepEP for Kimi-k2-thinking through enabling gemm selection for... · 7e082bc1
  Lucia Fang authored Nov 12, 2025
```
Support DeepEP for Kimi-k2-thinking through enabling gemm selection for compressed-tensor marlin wna16 (#28574)
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  7e082bc1
- [XPU] Support Triton path for LoRA operations on XPU (#28511) · dbbe0c75
  Fanli Lin authored Nov 13, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  dbbe0c75
- [BugFix][ROCm] Fix `get_cu_count` missing variable error (#28608) · 7dca0c90
  Pleaplusone authored Nov 13, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  7dca0c90
- [Frontend][responsesAPI][1/n] convert responses API tool input to chat... · 1a0b157a
  Andrew Xia authored Nov 12, 2025
```
[Frontend][responsesAPI][1/n] convert responses API tool input to chat completions tool format (#28231)
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  1a0b157a
- [Frontend] split append tool output (#28333) · 7c38ed0f
  Andrew Xia authored Nov 12, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  7c38ed0f
- [n-gen] DO NOT repeatedly return finished child requests (#28591) · a1d3866d
  Jialin Ouyang authored Nov 12, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a1d3866d
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
- [Docs] Add some details about what the MoE block needs for the Transformers backend (#28588) · 32262834
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  32262834
- [BugFix] Fix `mm_encoder_attn_backend` arg type checking (#28599) · 8832fff9
  Nick Hill authored Nov 12, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8832fff9
- [Bugfix] Fix SM100 gpt-oss regression due to faulty attn sink support (#28561) · a543e678
  Michael Goin authored Nov 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a543e678
- [platform] Move get_cu_count to utils (#27005) · 2dacd573
  wangxiyuan authored Nov 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2dacd573
- [ROCm][Bugfix] Revert removing setuptools version restriction (#28592) · d75ad048
  Gregory Shtrasberg authored Nov 12, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d75ad048
- [Docs] Update meetups.md description (#28583) · 52eadcec
  Michael Goin authored Nov 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  52eadcec
12 Nov, 2025 2 commits
- Skip models that cannot currently init on Transformers v5 (#28471) · 51c599f0
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51c599f0
- [MoE][Kernel][Perf] Improve Shared Expert Stream Overlap (#28406) · 69d0e903
  Alexander Matveev authored Nov 12, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  69d0e903