Commits · 79eb9369c5baa83db934407b0a448a5005c3dd72 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "fe743b798dfa56aea3e2cb7182365ba3495489ee"

20 Mar, 2026 40 commits
- fix CUDAGraph memory being counted twice (#37426) · 79eb9369
  Peter Pan authored Mar 21, 2026
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  79eb9369
- [MRV2] Avoid recompilation of _gather_block_tables_kernel (#37645) · e80cfe57
  Woosuk Kwon authored Mar 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  e80cfe57
- [Perf] Eliminate redundant SparseMatrix creation in gpt_oss_triton_kernels (#37683) · d0532bf3
  Xin Yang authored Mar 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d0532bf3
- [ROCm][CI] Fix accuracy for llama-nemotron-vl pooling tests (#37613) · fb4e8bf4
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  fb4e8bf4
- Fix various config related issues for Transformers v5 (#37681) · 6ade4bc5
  Harry Mellor authored Mar 20, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6ade4bc5
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [Metrics] Some small refactoring for better maintainability (#33898) · 880be2b1
  Martin Hickey authored Mar 20, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  880be2b1
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [Pixtral] Enable Pixtral language model support Eagle3 (#37182) · aa84e43c
  Rémi Delacourt authored Mar 20, 2026
```
Signed-off-by: remi <remi@mistral.ai>
```
  aa84e43c
- [Bugfix] Fix ConchLinearKernel channelwise quantization (group_size=-1) (#37329) · 5e806bcf
  Matthias Gehre authored Mar 20, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  5e806bcf
- [Bugfix] Reject channelwise quantization (group_size <= 0) in ExllamaLinearKernel (#37331) · 56a62c31
  Matthias Gehre authored Mar 20, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  56a62c31
- [ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709) · 1779c098
  L.B.R. authored Mar 20, 2026
```
Signed-off-by: L.B.R. <lbr@mmonad.com>
Co-authored-by: L.B.R. <lbr@mmonad.com>
```
  1779c098
- [ROCm][Quantization] make quark ocp mx dtype parser robust for weight-only quantization (#36232) · 44eea10f
  xuebwang-amd authored Mar 20, 2026
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  44eea10f
- [Model] Add LFM2-ColBERT-350M support (#37528) · 8b6c6b95
  Ilya Boytsov authored Mar 20, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
```
  8b6c6b95
- Fix attribute error in `isaac_patch_hf_runner` (#37685) · 9f6d9dd3
  Harry Mellor authored Mar 20, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9f6d9dd3
- [UX] Enable torch_profiler_with_stack (#37571) · dd20ee4e
  Jee Jee Li authored Mar 20, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dd20ee4e
- [Misc] Use logger.info_once for auto tool choice log message (#37661) · 0523449c
  Chauncey authored Mar 20, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  0523449c
- [Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500) · b4c1aef2
  Flora Feng authored Mar 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  b4c1aef2
- [Refactor] Move serve entrypoint tests under tests/entrypoints/serve/ (#37595) · 6050b93b
  Flora Feng authored Mar 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  6050b93b
- [ROCm][CI] Fix granite_speech test for gfx90a by selecting compatible attention backend (#37611) · 5a4a1795
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  5a4a1795
- [ROCm][CI] Remove deepep DBO tests on gfx90a (#37614) · 37cd9fc1
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  37cd9fc1
- [ROCm][CI] Update GSM8K eval config to use fp8-and-mixed models list (#37619) · 9cfd4ebb
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9cfd4ebb
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
- [Model Runner V2] Fix draft logits not populated during cudagraph replay (#37639) · dcee9be9
  Giancarlo Delfin authored Mar 20, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  dcee9be9
- [CI] Removing deprecated rlhf examples reference (#37585) · bd8c4c07
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bd8c4c07
- [Bug] Fix FlashInfer allreduce fusion workspace uninitialized error (#37461) · 0140eafb
  Wei Zhao authored Mar 20, 2026
```
Signed-off-by: root <root@prenyx0169.a51.clusters.nvidia.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: <>
Co-authored-by: root <root@prenyx0169.a51.clusters.nvidia.com>
Co-authored-by: root <root@prenyx0042.a51.clusters.nvidia.com>
```
  0140eafb
- [XPU] bump vllm-xpu-kernels to v0.1.4 (#37641) · bdf6a0a5
  Kunshang Ji authored Mar 20, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  bdf6a0a5
- [PluggableLayer][MM] Add PluggableLayer for CustomQwen2Decoder (#37293) · 0674d1fe
  Wangbei25 authored Mar 20, 2026
```
Signed-off-by: Wangbei25 <wangbei41@huawie.com>
Signed-off-by: Wangbei25 <wangbei41@huawei.com>
Co-authored-by: Wangbei25 <wangbei41@huawie.com>
```
  0674d1fe
- [Model] Refactor Step3-VL processor to HF style (#37579) · 30108fc8
  Cyrus Leung authored Mar 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  30108fc8
- [Refactor] Relocate entrypoint tests to match serving code structure (#37593) · e2d1c8b5
  Flora Feng authored Mar 20, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  e2d1c8b5
- [XPU] Automatically detect target platform as XPU in build. (#37634) · 6951fcd4
  Huanxing authored Mar 20, 2026
```
Signed-off-by: huanxing <huanxing.shen@intel.com>
```
  6951fcd4
- [Model Runner V2] fix draft attention metadata generation (#37364) · 39474513
  Giancarlo Delfin authored Mar 19, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  39474513
- fix(xpu): Re-compute compile ranges after platform-specific config updates (#37523) · 638a872d
  Yuxiang Liang authored Mar 20, 2026
```
Signed-off-by: Yuxiang Liang <yuxiang.liang@intel.com>
Signed-off-by: Yuxiang Liang <yuliang@habana.ai>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  638a872d
- [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) · 9040151f
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  9040151f
- [Bugfix][LoRA] Fix Qwen35 LoRA (#36976) · 8fbe3f30
  Jee Jee Li authored Mar 20, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8fbe3f30
- [compile][graph_partition]Add tensor size handling (#36038) · ea2c148f
  Xiao authored Mar 19, 2026
```
Signed-off-by: Xiao Fu <xiaofu@meta.com>
```
  ea2c148f
- [Feat] Enable CompressedTensorW4A8Int for XPU (#37207) · 47b7af0d
  Tianmu Li authored Mar 19, 2026
```
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
```
  47b7af0d
- fix: disambiguate multimodal prefix cache keys (#36708) · 269bf46d
  tianshu-Michael-yu authored Mar 19, 2026
```
Signed-off-by: tianshu.yu <tianshuyu.formal@gmail.com>
```
  269bf46d
- [CI] Update mergify tool-calling label paths (#37478) · e5a77a50
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  e5a77a50
- Fix DP coordinator ZMQ port TOCTOU (#37452) · ca1ac1a4
  Itay Alroy authored Mar 20, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  ca1ac1a4