Commits · 48c879369f83ab1ab281a4bfe97f9a54790715d1 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "40d86ee412eeeca93e0c37432db6b96829cb64e2"

12 Nov, 2025 3 commits
- [Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
  Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  48c87936
- [BugFix] Graceful handling of torch symm mem errors. (#27671) · 1788aa1e
  Ilya Markov authored Nov 12, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  1788aa1e
- Use FLASHINFER MLA backend when testing fp8_kv_scale_compile (#28491) · d2353954
  Adrian Abeyta authored Nov 11, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  d2353954
11 Nov, 2025 37 commits
- [Feature] Allow configuring FlashInfer workspace size (#28269) · 412e153d
  Max Hu authored Nov 11, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  412e153d
- [Bugfix] Disable shared expert overlap if Marlin MoE is used (#28410) · e5f599d4
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e5f599d4
- Add Zurich vLLM Meetup (#28488) · 28534b92
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  28534b92
- [Misc] Cleanup Executor interface (#28441) · d4902ba5
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  d4902ba5
- [TPU] Rename path to tpu platform (#28452) · df4d3a44
  Kyuyeun Kim authored Nov 11, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  df4d3a44
- [LoRA][1/N]Remove LoRA extra vocab (#28382) · 9d1c4747
  Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9d1c4747
- [Misc] fix typo in DCP comment (#28389) · 8c32c6e4
  Jie Luo authored Nov 12, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  8c32c6e4
- [V0 deprecation] Clean up num_prefill_tokens logic for V0 (#28203) · de120bc9
  Canlin Guo authored Nov 12, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  de120bc9
- [Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245) · 4228be79
  Jialin Ouyang authored Nov 11, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4228be79
- [Misc] Remove unused attention prefix prefill ops functions (#26971) · 76e4dcf2
  Lukas Geiger authored Nov 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  76e4dcf2
- [BugFix] Fix Siglip2Attention on XPU (#28448) · d5edcb86
  Fanli Lin authored Nov 12, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  d5edcb86
- [Kernel] Optimize rms_norm kernel (#27931) · 6c3c0f82
  Xin Yang authored Nov 11, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  6c3c0f82
- Prefer FlashAttention MLA as default over FlashMLA (#27363) · 684f2545
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  684f2545
- [CI/Build] Refactor Attention backend for test_prefix_prefill from xformers to SDPA (#28424) · e5534249
  Zhewen Li authored Nov 11, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  e5534249
- [Quantization] fix attention quantization of gpt_oss model (#27334) · 5a1271d8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  5a1271d8
- [ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  05576df8
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc
- [NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282) · a7ef3eb0
  Nicolò Lucchesi authored Nov 11, 2025
  
  a7ef3eb0
- Remove weight_scale.T special case for SM90 Block FP8 CUTLASS kernel (#28431) · f9a40871
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f9a40871
- [Doc] Fix typo in serving docs (#28474) · 287bbbeb
  the-codeboy authored Nov 11, 2025
```
Signed-off-by: the-codeboy <71213855+the-codeboy@users.noreply.github.com>
```
  287bbbeb
- [BugFix] Add test_outputs.py to CI pipeline (#28466) · 3143eb23
  usberkeley authored Nov 12, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3143eb23
- [BugFix] Fix RuntimeError in PixtralHFAttention on CPU/XPU (#28444) · b8860680
  Fanli Lin authored Nov 11, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  b8860680
- Add @markmc to CODEOWNERS for Observability (#28457) · a90ad7d8
  Mark McLoughlin authored Nov 11, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  a90ad7d8
- [BugFix] Fix Failing Ruff Check (#28469) · 533b018f
  jvlunteren authored Nov 11, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  533b018f
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
- [Docs] Fix grammar in CPU installation guide (#28461) · fa197020
  Maryam Tahhan authored Nov 11, 2025
```
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
```
  fa197020
- Add request timeout override for multi-turn benchmarks (#28386) · 3380543b
  Ido Segev authored Nov 11, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  3380543b
- [Model] Pass `mm_features` directly into `get_mrope_input_positions` (#28399) · afffd3cc
  Cyrus Leung authored Nov 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afffd3cc
- Fix Fused MoE LoRA Triton kernel bug (#28450) · 7dbe6d81
  Chaojun Zhang authored Nov 11, 2025
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
```
  7dbe6d81
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
- [CI] Add mergify rules for `nvidia` label (#28417) · 2e78150d
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  2e78150d
- Multi turn benchmark progress bar for synthetic conversation generation (#28394) · d381eb96
  Ido Segev authored Nov 11, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  d381eb96
- [Model][Qwen3VL] Slighly speedup `fast_pos_embed_interpolate` (#28434) · 9973e6e0
  Lukas Geiger authored Nov 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  9973e6e0
- [BugFix] 'DeepseekV2Config' object has no attribute 'use_mla'` (#28387) · c7991269
  Fanli Lin authored Nov 11, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  c7991269
- [Bugfix] fix qwen3-next crash (#28202) · f0359fff
  Jiangyun Zhu authored Nov 11, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  f0359fff
- [EPLB] Refactor balance_packing to use numpy and optimize GPU-CPU transfers in EPLB (#28369) · 798c7beb
  Sage Moore authored Nov 11, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  798c7beb
- [Bugfix] Fix max image size for PaddleOCR-VL (#28442) · 4fd4b743
  Roger Wang authored Nov 11, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  4fd4b743