Commits · 606b00e80f32698544b117f6c8fbf9265eae61dc · OpenDAS / vllm_cscc · GitLab

10 Oct, 2025 11 commits
- [bugfix][DCP] fix block_size of hash in DCP prefix caching (#26296) · 606b00e8
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  606b00e8
- [CI] fix ruff format (#26579) · 720d3cd0
  Chauncey authored Oct 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  720d3cd0
- Remove LoRA bias support (#25807) · ab196ede
  Ashwin Phadke authored Oct 10, 2025
```
Signed-off-by: Ashwin Phadke <ashwinphadke12@rediffmail.com>
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ab196ede
- [GPT-OSS] Add support for arrays at tool message content (#25593) · 3ee202ea
  Luis Tomas Bolivar authored Oct 10, 2025
```
Signed-off-by: Luis Tomas Bolivar <ltomasbo@redhat.com>
```
  3ee202ea
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
- [deepseek] kernel block size for UniformTypeKVCacheSpecs (#26559) · 6f0f570c
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6f0f570c
- fix test_simple_inductor_graph_partition (#26522) · b545a0b2
  Boyuan Feng authored Oct 09, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  b545a0b2
- [Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc
  Lucas Wilkinson authored Oct 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  29255cfc
- [Chore]: One pythonic tool parser test uses the wrong parser (#26515) · da445560
  Ben Browning authored Oct 10, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
  da445560
- [Core] Small simplification in `GPUModelRunner._update_states()` (#26508) · aafb99a4
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aafb99a4
- [DP][ray] Support different VLLM_RAY_DP_PACK_STRATEGY (#23849) · 757fa4a4
  Rui Qiao authored Oct 09, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  757fa4a4
09 Oct, 2025 29 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [CI] Fix Pre-commit Issue Cannot determine type of "rank" and "world_size" (#26448) · 8983e021
  Wentao Ye authored Oct 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  8983e021
- [Bug] Fix modular_kernel: ZeroDivisionError: integer division or modulo by zero (#26528) · 1ee35382
  Wentao Ye authored Oct 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1ee35382
- [Bugfix] Fix CUDA graph selection bug in FlashInfer at high concurrency (#26499) · 6e783bc5
  Benjamin Chislett authored Oct 09, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  6e783bc5
- [UX] Add FlashInfer as default CUDA dependency (#26443) · c9d33c60
  Michael Goin authored Oct 09, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c9d33c60
- [Core] Remove unused `prev_sampled_token_ids_invalid_indices` input batch field (#26514) · 2e54db4d
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2e54db4d
- [Flashinfer][gpt-oss] Support FP8-qkv Flashinfer TRTLLM Sinks Attention (#25674) · 44f633db
  elvischenv authored Oct 10, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  44f633db
- [Bugfix] Disable moe inplace for torch >= 2.9 (#26497) · a462331e
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  a462331e
- [Bugfix] Enable padded FP4 quantization (#25947) · 4069db3f
  roikoren755 authored Oct 09, 2025
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  4069db3f
- [BUGFIX] Add cu_tokens_across_sp to DPMetadata (#26457) · 0d37450e
  Sage Moore authored Oct 09, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  0d37450e
- [Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  47e66c24
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
- [Models][Qwen] Replace `pad` with `cat` for better performance (#26486) · 2c1c7dfb
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  2c1c7dfb
- Upgrade Pydantic to v2.12.0 and remove hack for Python 3.13 (#26481) · e246ad6f
  Harry Mellor authored Oct 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e246ad6f
- Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate... · 5728da11
  Jiangyun Zhu authored Oct 09, 2025
```
Revert  #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  5728da11
- [Feature] Use pydantic validation in parallel.py config (#26417) · 92be3f35
  Simon Danielsson authored Oct 09, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  92be3f35
- [V0 deprecation] Remove `QKVCrossParallelLinear` implementation (#26475) · d1ddf340
  Isotr0py authored Oct 09, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d1ddf340
- [Bugfix] Move current_platform import to avoid python import cache. (#16601) · ec10fd0a
  Wenzheng Bi authored Oct 09, 2025
```
Signed-off-by: iwzbi <wzbi@zju.edu.cn>
```
  ec10fd0a
- [Models][Qwen3VL] Optimise `_validate_and_reshape_mm_tensor` (#26426) · 0426e3c5
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0426e3c5
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
- [Misc] Upgrade more code to Python 3.10 (#26463) · dc7976dd
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dc7976dd
- [Feature] Use pydantic validation in lora.py and load.py configs (#26413) · e4791438
  Simon Danielsson authored Oct 09, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  e4791438
- [doc] add Volcengine as a compute sponsor (#26477) · e6e898f9
  youkaichao authored Oct 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e6e898f9
- [Misc] Misc code simplifications (#26450) · ddcbc2f3
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ddcbc2f3
- [torchao] Add support for ModuleFqnToConfig using regex (#26001) · a83ff278
  Jerry Zhang authored Oct 09, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  a83ff278
- Add: Support for multiple hidden layers in Eagle3 (#26164) · cf4cd6c2
  Rahul Tuli authored Oct 09, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  cf4cd6c2
- Enable `RMSNorm` substitution for Transformers backend (#26353) · b9604418
  Harry Mellor authored Oct 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b9604418
- [Model] Gemma3: Fix GGUF loading and quantization (#26189) · 1317028a
  Luciano Martins authored Oct 09, 2025
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  1317028a
- Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
  elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5e49c3e7