Commits · 950cf9e58eefd8e6436eb04b442184353c06a571 · OpenDAS / vllm_cscc · GitLab

17 Oct, 2025 35 commits
- [Bugfix] Use PIECEWISE cudagraphs on Blackwell if max_model_len > 131072 (#27114) · 950cf9e5
  Michael Goin authored Oct 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  950cf9e5
- [Chore] Remove unused `PolyNorm` layer (#27110) · 3125d799
  Isotr0py authored Oct 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3125d799
- [Bugfix] [AITER] [ROCm] Fix Quark MoE Quant Config and AITER Fused MoE quant type logic (#27029) · e33ee23e
  vllmellm authored Oct 18, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  e33ee23e
- [ROCm][Bugfix][Model] Fix illegal memory access when running qwen3_moe models... · b10c64c8
  rasmith authored Oct 17, 2025
```
[ROCm][Bugfix][Model] Fix illegal memory access when running qwen3_moe models with  rms_norm (Qwen3-235B-A22B,  Qwen3-30B-A3B, etc.) (#26192)
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Signed-off-by: rasmith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b10c64c8
- [ROCM] MoE fp4 CK kernel (#26545) · 0925b28a
  Aleksandr Malyshev authored Oct 17, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  0925b28a
- [CI] Remove forbidden slash (#27112) · 99722d5f
  Nicolò Lucchesi authored Oct 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  99722d5f
- [bugfix] Qwen3-VL fix video incorrect timestamp calculations while do_sample_frames=True (#27104) · 4c91a28e
  燃 authored Oct 18, 2025
```
Co-authored-by: 松灵 <wpf272043@alibaba-inc.com>
```
  4c91a28e
- [Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367) · b038d9c4
  Patrick von Platen authored Oct 17, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  b038d9c4
- [CI] Nixl integration tests (#27010) · 2ba60ec7
  Nicolò Lucchesi authored Oct 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2ba60ec7
- [torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604) · bd7157a0
  Luka Govedič authored Oct 17, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bd7157a0
- Fix incorrect docstring for stop_profile() method (#27101) · be429d0c
  Yongtao Huang authored Oct 17, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
  be429d0c
- [Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI350 and MI355 (#25586) · c253745e
  Reima Karhila (AMD) authored Oct 17, 2025
```
Signed-off-by: Reima Karhila <reima.karhila@amd.com>
Signed-off-by: xaguilar <Xavier.AguilarFruto@amd.com>
Co-authored-by: xaguilar <Xavier.AguilarFruto@amd.com>
```
  c253745e
- [Model]Improve Qwen3VLMoeForConditionalGeneration packed_modules_mapping (#27096) · daec4d26
  Jee Jee Li authored Oct 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  daec4d26
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- [Docs] Replace all explicit anchors with real links (#27087) · 483ea646
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  483ea646
- [VLM][Refactor] Remove useless func `get_input_positions` in `MRotaryEmbedding` (#27088) · e20eba75
  Mengqing Cao authored Oct 17, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  e20eba75
- Update troubleshooting.md and remind VLLM_TRACE_FUNCTION usage (#27069) · bbc1b296
  cong-meta authored Oct 17, 2025
```
Signed-off-by: cong-meta <prowindy@hotmail.com>
```
  bbc1b296
- [CI] fix docs build failed (#27082) · acb1bfa6
  Chauncey authored Oct 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  acb1bfa6
- [Kernel][Performance] Fuse float cast and renormalize to topk softmax kernel (#26717) · 75c7ad99
  zhrrr authored Oct 17, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  75c7ad99
- [CI/Build] Update compressed tensor test path to fix CPU CI (#27068) · 5550ff9c
  Li, Jiang authored Oct 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  5550ff9c
- [Model] Add support for LightOnOCR (#26916) · 3aeb19a3
  Said Taghadouini authored Oct 17, 2025
```
Signed-off-by: Said Taghadouini <taghadouinisaid@gmail.com>
Signed-off-by: Said Taghadouini <84044788+staghado@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  3aeb19a3
- [Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c017b34
- [CI/Build] Update Llama4 eval yaml (#27070) · 9c2c2287
  Zhewen Li authored Oct 16, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  9c2c2287
- [Kernel] Lazy import FlashInfer (#26977) · fec2b341
  Jee Jee Li authored Oct 17, 2025
  
  fec2b341
- [Bugfix] Fix ReplicatedLinearWithLoRA (#27065) · 87bc0c49
  Jee Jee Li authored Oct 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  87bc0c49
- [Core] Change `execute_model_with_error_logging()` to be a ctx manager (#27060) · fe3b9372
  Nick Hill authored Oct 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  fe3b9372
- [Bugfix][Qwen] fixes the weights dtype in qwen3_next: it is actually a bfloat16 (#27030) · bde9e227
  Tao He authored Oct 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  bde9e227
- disable graph partition in custom op (#26952) · 08405609
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  08405609
- [Perf] Exploit out-of-band buffers in shm_broadcast (#26961) · ab81379e
  Nick Hill authored Oct 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ab81379e
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
- vllm bench serve shows num of failed requests (#26478) · 965c5f49
  Tomas Ruiz authored Oct 17, 2025
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  965c5f49
- Remove unused imports (#26972) · 4d055ef4
  Lukas Geiger authored Oct 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4d055ef4
- [torch.compile] fix simple inductor graph partition test (#27050) · 17c540a9
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  17c540a9
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
- [torch.compile] Passing only necessary compilation config to inductor pass config (#27041) · 11ae016b
  Lucia Fang authored Oct 16, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  11ae016b
16 Oct, 2025 5 commits
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
- Refactor Transformers backend to use mixins (#26906) · fb5e10d3
  Harry Mellor authored Oct 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb5e10d3
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [Bug] Add Assertion for `random-input-len` / `random-output-len` (#26834) · 23583ee2
  Wentao Ye authored Oct 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  23583ee2
- [CI] Prune Quantization Tests and skip compilation (#27038) · 01c977e9
  Michael Goin authored Oct 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  01c977e9