Commits · ec965569d94c09eb1c85d235319b24d1b795d048 · OpenDAS / vllm_cscc · GitLab

18 Dec, 2025 16 commits
- [KV connector][LMCache] Only record the cuda event when there are request to store/load (#30814) · ec965569
  Yihua Cheng authored Dec 17, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  ec965569
- [AMD][CI] fix lm eval ci arg (#30911) · 82dc338a
  Divakar Verma authored Dec 17, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  82dc338a
- [PERF] Qwen3-next. Add fp8 cutlass MoE tuned configs. `chmod -x *MI308X.json` (#29553) · 717ac33d
  Vadim Gimpelson authored Dec 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  717ac33d
- [Doc][CPU] Update CPU doc (#30765) · cfb7e555
  Li, Jiang authored Dec 18, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  cfb7e555
- [refactor] Add prefix support to embed_tokens in DeepSeek MTP (#30788) · b166ef20
  zzhxxx authored Dec 18, 2025
```
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
```
  b166ef20
- [compile] Fix CI for test_gpt2_cache_hit (#30902) · 5f2f3fba
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  5f2f3fba
- [UX] Reduce DeepGEMM warmup log output to single progress bar (#30903) · 4a8412f7
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4a8412f7
- [Quantization] Support Quark int4-fp8 w4a8 for MoE (#30071) · 0c738b58
  Bowen Bao authored Dec 17, 2025
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
  0c738b58
- fused_moe_lora PDL improvements (#30716) · 5a3adf58
  gnovack authored Dec 17, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  5a3adf58
- [Chore] Remove v0 dead code for Qwen2.5-omni (#30883) · 6fe58876
  Isotr0py authored Dec 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6fe58876
- [NIXL] Support P tensor-parallel-size > D tensor-parallel-size (#27274) · bc3700e0
  Nicolò Lucchesi authored Dec 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  bc3700e0
- [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) · fd8afdf3
  Micah Williamson authored Dec 17, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  fd8afdf3
- [Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9
  SungMinCho authored Dec 17, 2025
```
Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  a0b782f9
- [CI][Feature] Adds auto-rebase PR rule (#30875) · ed2897f3
  Rafael Vasquez authored Dec 17, 2025
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
  ed2897f3
- [v1] Add PrefixLM support to TritonAttention backend (#30386) · 74a1ac38
  Isotr0py authored Dec 18, 2025
  
  74a1ac38
- feat(api): Eager chat template warmup to eliminate first-request latency (#30700) · 05a83dc6
  Nathan Price authored Dec 17, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
```
  05a83dc6
17 Dec, 2025 24 commits
- [BugFix] Workspace allocation during profile run : DeepEPHighThroughput + DeepGEMM (#30899) · e3fc374a
  Varun Sundar Rabindranath authored Dec 17, 2025
  
  e3fc374a
- 2.9.1 PyTorch release update (#28495) · e06d0bf0
  Andrey Talman authored Dec 17, 2025
  
  e06d0bf0
- [docs]: add ecosystem projects sr in docs/governance (#30844) · e3a0f21e
  Xunzhuo authored Dec 18, 2025
```
Signed-off-by: bitliu <bitliu@tencent.com>
```
  e3a0f21e
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
- [CI][Bugfix] Fix flaky `tests/entrypoints/openai/test_audio.py::test_chat_streaming_audio` (#30878) · 9ca8cb38
  Nicolò Lucchesi authored Dec 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  9ca8cb38
- [Chore] Factor out logic for requesting initial memory (#30868) · 2497228a
  Cyrus Leung authored Dec 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2497228a
- [Model] Gemma3: Support untied word embeddings (#30827) · 196cdc32
  KimHyemin authored Dec 18, 2025
```
Signed-off-by: www-spam <panmahm@naver.com>
```
  196cdc32
- Adapt the old parameter enable_thinking in chat_template_kwargs (#30852) · b7b6a60a
  高鑫崧 authored Dec 17, 2025
```
Signed-off-by: xinsong.gao <1418762819@qq.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  b7b6a60a
- [Docs] fix function name (#30748) · 9e67c4ce
  rongfu.leng authored Dec 17, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  9e67c4ce
- [Fix] uniform decode batch check (#30747) · 6e9dbcc5
  Jialin Ouyang authored Dec 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  6e9dbcc5
- chores: adjust the attn register param order (#30688) · 6482e389
  Hank_ authored Dec 17, 2025
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
  6482e389
- Fix lazy import (#30858) · fb980eb2
  Harry Mellor authored Dec 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb980eb2
- [Bugfix] deepseek-V3.2 self.weights_proj has no bias (#30841) · 84896fda
  baoqian426 authored Dec 17, 2025
```
Signed-off-by: baoqian <1354987947@qq.com>
Signed-off-by: baoqian426 <1354987947@qq.com>
```
  84896fda
- [ci] Sync test areas yaml file with test-pipeline (#30862) · 4bf6c236
  Kevin H. Luu authored Dec 17, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  4bf6c236
- [Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749) · 9ad5b217
  Chauncey authored Dec 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9ad5b217
- [Bug] Fix AttributeError: 'ColumnParallelLinear' object has no attribute... · f284d7bd
  Wentao Ye authored Dec 17, 2025
```
[Bug] Fix AttributeError: 'ColumnParallelLinear' object has no attribute `weight_scale_inv` (#30823)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f284d7bd
- [compile] Recompile graph module during Dynamo cache loading. (#30743) · 53cd7f86
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: Zhengxu Chen <zhxchen17@fb.com>
```
  53cd7f86
- [Fix]Load kv-cache dtype from hf_quant_config.json automatically (fix for reverted PR) (#30785) · 7b966ae2
  danielafrimi authored Dec 17, 2025
```
Signed-off-by: <>
Co-authored-by: root <root@gpu-937.slurm-workers-slurm.slurm.svc.cluster.local>
```
  7b966ae2
- [compile] Ignore VLLM_FORCE_AOT_LOAD from cache factors (#30809) · 9db1db59
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  9db1db59
- [compile] Disable aot when eager backend is used. (#30810) · 177c391d
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  177c391d
- [UX] Make `vllm bench serve` discover model by default and use --input-len (#30816) · 519ef9a9
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  519ef9a9
- [Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842) · a1001522
  Ye (Charlotte) Qi authored Dec 17, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a1001522
- [Doc][ResponsesAPI] add documentation (#30840) · 4c054d89
  Andrew Xia authored Dec 17, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4c054d89
- [NIXL][Bugfix] Fix NIXL/RDMA registration failure over CuMemAllocator (#29569) · f4e884f2
  Sheng Lin authored Dec 17, 2025
```
Signed-off-by: Somoku <linsh0@protonmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  f4e884f2