Commits · fe3b9372adfe968360c6754c15058380ab5e87f1 · OpenDAS / vllm_cscc · GitLab

17 Oct, 2025 10 commits
- [Core] Change `execute_model_with_error_logging()` to be a ctx manager (#27060) · fe3b9372
  Nick Hill authored Oct 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  fe3b9372
- [Bugfix][Qwen] fixes the weights dtype in qwen3_next: it is actually a bfloat16 (#27030) · bde9e227
  Tao He authored Oct 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  bde9e227
- disable graph partition in custom op (#26952) · 08405609
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  08405609
- [Perf] Exploit out-of-band buffers in shm_broadcast (#26961) · ab81379e
  Nick Hill authored Oct 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ab81379e
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
- vllm bench serve shows num of failed requests (#26478) · 965c5f49
  Tomas Ruiz authored Oct 17, 2025
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  965c5f49
- Remove unused imports (#26972) · 4d055ef4
  Lukas Geiger authored Oct 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4d055ef4
- [torch.compile] fix simple inductor graph partition test (#27050) · 17c540a9
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  17c540a9
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
- [torch.compile] Passing only necessary compilation config to inductor pass config (#27041) · 11ae016b
  Lucia Fang authored Oct 16, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  11ae016b
16 Oct, 2025 30 commits
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
- Refactor Transformers backend to use mixins (#26906) · fb5e10d3
  Harry Mellor authored Oct 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb5e10d3
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [Bug] Add Assertion for `random-input-len` / `random-output-len` (#26834) · 23583ee2
  Wentao Ye authored Oct 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  23583ee2
- [CI] Prune Quantization Tests and skip compilation (#27038) · 01c977e9
  Michael Goin authored Oct 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  01c977e9
- [Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to... · b3dda72c
  Wentao Ye authored Oct 16, 2025
```
[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to `get_mk_alignment_for_contiguous_layout` (#26935)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b3dda72c
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0
- [Bug] Fix batch invariant test `has` to `is` (#27032) · 2ed8b6b3
  Wentao Ye authored Oct 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2ed8b6b3
- Adding Warmup to Benchmark Serving (#26943) · 013abde6
  kimbochen authored Oct 16, 2025
```
Signed-off-by: Kimbo Chen <chentenghung@gmail.com>
```
  013abde6
- [Compressed Tensors] Always clone output for compile robustness (#26849) · a5464dcf
  Kyle Sayers authored Oct 16, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  a5464dcf
- Support block size of 256 used by Intel HPU (#26883) · ac3ed5a8
  Mandy Li authored Oct 16, 2025
```
Signed-off-by: mandy-li <mandy.j.li@intel.com>
```
  ac3ed5a8
- [gpt-oss][1/N] EZ: refactor serving_responses for modularity (#26948) · e6ba2000
  Andrew Xia authored Oct 16, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  e6ba2000
- Support `set` in the CLI generation (#27031) · aa255ff5
  Harry Mellor authored Oct 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aa255ff5
- Fix Qwen2.5 VL image grid docstring (#27033) · 7bb736d0
  ZiTian Zhao authored Oct 17, 2025
```
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
```
  7bb736d0
- [Model] Fix Qwen3VL mm mapping (#27027) · 9f4e3090
  Jee Jee Li authored Oct 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9f4e3090
- [Feature] Add process_weights_after_loading to AttentionImpl (#26870) · 5afd3276
  rongfu.leng authored Oct 16, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  5afd3276
- [CI] Replace large models with tiny alternatives in tests (#24057) · 43721bc6
  Tahsin Tunan authored Oct 16, 2025
```
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  43721bc6
- [docs] standardize Hugging Face env var to `HF_TOKEN` (deprecates... · 02d709a6
  Kay Yan authored Oct 16, 2025
```
[docs] standardize Hugging Face env var to `HF_TOKEN` (deprecates `HUGGING_FACE_HUB_TOKEN`) (#27020)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  02d709a6
- [NIXL] Improve request_finished() debug logs (#25665) · 4a510ab4
  Mark McLoughlin authored Oct 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  4a510ab4
- [Attention] Tune CUTLASS MLA num_splits (#26846) · 314fa8ab
  Matthew Bonanni authored Oct 16, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  314fa8ab
- [Benchmark] Show E2EL by default for pooling models (#27014) · 334535b6
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  334535b6
- [Bugfix] Correct LayerNorm epsilon parameter in modernbert.py (#27008) · dcbb3f18
  bogdanm authored Oct 16, 2025
```
Signed-off-by: bogdanm <152898065+bogdan01m@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  dcbb3f18
- [MISC] fix import violations for re and triton modules (#26654) · 00417f4e
  Sungjae Lee authored Oct 16, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
```
  00417f4e
- Cleanup code after Python 3.10 upgrade (#26520) · ed344f41
  Lukas Geiger authored Oct 16, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  ed344f41
- [Model][Bugfix] fix ernie45 vl run failed from shared experts optimization (#26885) · e5192879
  CSWYF3634076 authored Oct 16, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  e5192879
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [Benchmark] Use truncation by default for pooling benchmarks (#26992) · 17838e50
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  17838e50
- [CI/Build] Fix AMD import failures in CI (#26841) · 44c85556
  Zhewen Li authored Oct 16, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  44c85556
- [Hardware][CPU][PowerPC]Disable torch.compile() in toptopk sampling (#26987) · f7d318de
  Akash kaothalkar authored Oct 16, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  f7d318de
- [CI/Build] Update expected beam search output for Phi3V (#26978) · 76f0d05b
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  76f0d05b