Commits · e2ed238885be6af358be1851cd43105b7d036c49 · OpenDAS / vllm_cscc · GitLab

15 Dec, 2025 1 commit
- Revert "[Fix]Load kv-cache dtype from hf_quant_config.json automatically" (#30653) · e2ed2388
  Robert Shaw authored Dec 14, 2025
  
  e2ed2388
14 Dec, 2025 24 commits
- CPU KV Offloading: Use more CUDA streams (#29013) · 174e39ea
  Or Ozeri authored Dec 15, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  174e39ea
- [responsesAPI]add extra body parameters (#30532) · 9ccbf6b6
  RioS authored Dec 15, 2025
```
Signed-off-by: Ri0S <aa248424@gmail.com>
```
  9ccbf6b6
- [NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) · ae2e503d
  Chendi.Xue authored Dec 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  ae2e503d
- [Model][Quantization] Override HF defaults to GGUF ones (incl. Qwen3 MoE) (#30118) · 9e33a1a7
  Tsukasa OI authored Dec 15, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  9e33a1a7
- [Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596) · add4b0ca
  Vensen authored Dec 14, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
```
  add4b0ca
- [Feature]Add EVS (Efficient Video Sampling) Support for Qwen3-VL (#29752) · ae88aada
  ZiTian Zhao authored Dec 14, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: deitxfge <huhaibo1990@126.com>
```
  ae88aada
- [Bugfix] Improve error messages in ModelConfig validation (#30213) · 5ccf0efa
  yifant-code authored Dec 14, 2025
```
Signed-off-by: ytian218 <ytian218@bloomberg.net>
Co-authored-by: ytian218 <ytian218@bloomberg.net>
```
  5ccf0efa
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
- [Bugfix] Revert Qwen2-VL part of change in #28271 (#30542) · 48b8456f
  zifeitong authored Dec 14, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  48b8456f
- [Bugfix] Update get_processor_data to use get_all method (#30583) · 5b64ac21
  Drew Botwinick authored Dec 14, 2025
```
Signed-off-by: Drew Botwinick <6953152+dbotwinick@users.noreply.github.com>
```
  5b64ac21
- [Misc] Add a script to benchmark compilation time (#29919) · a8ec4865
  Bin Bao authored Dec 14, 2025
```
Signed-off-by: Bin Bao <binbao@meta.com>
```
  a8ec4865
- [Bugfix] fix _get_quant_method of FusedMoE for deepseekV3.2 on non-NV… (#30057) · 6ecc1e41
  tjp_zju authored Dec 14, 2025
```
Signed-off-by: tjp_zju <tanjianpingzju1990@gmail.com>
```
  6ecc1e41
- Nvidia ModelOpt workaround for issue 28072 (#30164) · 0bb0bae4
  Shengliang Xu authored Dec 14, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>
```
  0bb0bae4
- fix: Update json features supported by xGrammar (#30390) · 06089365
  Johannes F authored Dec 14, 2025
```
Signed-off-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Signed-off-by: Johannes F <johannesflommersfeld@users.noreply.github.com>
Co-authored-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  06089365
- [Bugfix] awq_gemm: fix argument order swap (#30364) · e9add129
  Matthias Gehre authored Dec 14, 2025
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e9add129
- [torch.compile] Add encoder tag for compilation (#30489) · 3224ea99
  Ilya Markov authored Dec 14, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  3224ea99
- Add AudioFlamingo3 model support (#30539) · 3a20450d
  Lasha Koroshinadze authored Dec 14, 2025
```
Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
Signed-off-by: Lasha Koroshinadze <26011196+lashahub@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  3a20450d
- [Doc]: fixing typos in various files (#30540) · 1a55cfaf
  Didier Durand authored Dec 14, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  1a55cfaf
- [main][BugFix] Fixed an accuracy bug of Qwen3-next-MTP when batched inferring (#30632) · add1b9d3
  drslark authored Dec 14, 2025
```
Signed-off-by: drslark <slarksblood@qq.com>
```
  add1b9d3
- [Chore] Remove redundant `RequestPrompt` (#30612) · dcb31196
  Cyrus Leung authored Dec 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcb31196
- enable unbacked with aot_compile (#30462) · f569c654
  Laith Sakka authored Dec 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  f569c654
- [ROCm][CI] Add "Qwen3-Next-80B-A3B-Instruct MTP Async EPLB Accuracy Test" Back Into AMD CI (#30590) · 97f2f160
  Micah Williamson authored Dec 14, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  97f2f160
- Improve parse_raw_prompt test cases for invalid input .v2 (#30512) · 29f7d977
  Kayvan Mivehnejad authored Dec 13, 2025
```
Signed-off-by: Kayvan Mivehnejad <K.Mivehnejad@gmail.com>
```
  29f7d977
- [Bug][KVConnector][Metrics] Remove a vacuous assertion breaking external-launcher (#30577) · dc7fb5be
  Qier Li authored Dec 13, 2025
```
Co-authored-by: Qier Li <qier@fb.com>
```
  dc7fb5be
13 Dec, 2025 15 commits
- [Doc] Add instructions for building docker image on GB300 with CUDA13 (#30414) · 24429d59
  Qidong Su authored Dec 13, 2025
```
Signed-off-by: Qidong Su <soodoshll@gmail.com>
```
  24429d59
- [Logs] Optimize startup logs 4 (#29903) · 6e78ed6b
  Wentao Ye authored Dec 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6e78ed6b
- [Doc] Add documents for multi-node distributed serving with MP backend (#30509) · 7c16f3fb
  Isotr0py authored Dec 14, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7c16f3fb
- [Docs] Clarify Expert Parallel behavior for attention and MoE layers (#30615) · ddbfbe52
  lif authored Dec 14, 2025
```
Signed-off-by: majiayu000 <1835304752@qq.com>
```
  ddbfbe52
- set assume_32bit_indexing and pass unbacked hints (#30459) · 763963aa
  Laith Sakka authored Dec 13, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  763963aa
- [Refactor] `TokenizerRegistry` only uses lazy imports (#30609) · 39cefbdf
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39cefbdf
- [Bugfix] Qwen3-next with --hf-overrides \{\"num_hidden_layers\":8\} (#30433) · ace34e37
  Chen Zhang authored Dec 13, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  ace34e37
- [CI/Build] Fix broken mm processor test Mistral-3-large (#30597) · e5db3e27
  Isotr0py authored Dec 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e5db3e27
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
- [Scheduer] Simplify stop checking for pooling models (#30591) · 1cec5b7e
  Nick Hill authored Dec 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  1cec5b7e
- [Bugfix] Dictionary MM embeddings for online chat (#30507) · b09806e2
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09806e2
- [Misc][Quantization] Clarify the intent of GGUF `FusedMoE` weight materialization (#30310) · fdc135d7
  Tsukasa OI authored Dec 13, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  fdc135d7
- [Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46
  Roberto L. Castro authored Dec 13, 2025
```
Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  4fa7ce46
- [CI] Whisper logprobs tests (#30504) · 57e9bf18
  Nicolò Lucchesi authored Dec 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  57e9bf18
- [CI] Update several models in registry that are available online now (#30514) · 2f32a68d
  Michael Goin authored Dec 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  2f32a68d