Commits · 0abc79482a6d476f58530907443c46134ba6e2e1 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "134f70b3eddf05f01f55ecee9c2a14ec0732e8b6"

25 Nov, 2025 40 commits
- [caching] Add enable_prompt_embeds and cpu_offload_gb to compile hashes. (#29435) · 0abc7948
  Zhengxu Chen authored Nov 25, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  0abc7948
- [Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4e57c658
- [Compile] Refactor. Move PostGradPassManager out of Compilation config (#29340) · e7d77627
  Ilya Markov authored Nov 25, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  e7d77627
- [responsesAPI][2] parse ResponseFunctionToolCallOutputItem (#29383) · b07555d2
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  b07555d2
- Fix RoPE related failures in Transformers nightly tests (#29333) · 0353d2e1
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0353d2e1
- Scheduled removal of `override_pooler_config` and `disable_log_requests` (#29402) · a1f26768
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a1f26768
- [Hybrid Allocator] Support KV cache groups with different block_size (#29143) · 48ddb02b
  Yifan Qiao authored Nov 25, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  48ddb02b
- [Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e5020986
- [UX] Put CUDA attention backend selection log into one line (#29337) · dbc3d999
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  dbc3d999
- [Feature]: Improve GGUF loading from HuggingFace user experience like repo_id:quant_type (#29137) · 794029f0
  Injae Ryou authored Nov 25, 2025
```
Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  794029f0
- Revert back to torch.equal over torch.allclose from #28819 (#29086) · 0231ce83
  Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  0231ce83
- [Bugfix] Fix logic for choosing default prefix caching setting (#29393) · 516c3f78
  Thomas Parnell authored Nov 25, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  516c3f78
- Scheduled removal of `CompilationConfig.use_inductor` (#29323) · 51fc9e01
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51fc9e01
- [Bugfix] Fix overallocation in MM profiling (#29386) · c2c661af
  Roger Wang authored Nov 25, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  c2c661af
- [Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper... · 798e87db
  Nicolò Lucchesi authored Nov 25, 2025
```
[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper hardcoded logic   (#29268)
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  798e87db
- [Misc] Suppress log outputs when constructing the default vllm config. (#29291) · de688994
  wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  de688994
- [Frontend] Respect Chat Completion parallel_tool_calls param (#26233) · e1dd706c
  Ben Browning authored Nov 25, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e1dd706c
- [responsesAPI] refactor construct_input_messages (#29359) · a685b47c
  Andrew Xia authored Nov 25, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  a685b47c
- [BugFix] bad_words filtering ineffective when n > 1 (#29313) · 32c40b95
  Avishek Goswami authored Nov 25, 2025
```
Signed-off-by: GOavi101 <1704178@kiit.ac.in>
```
  32c40b95
- [Misc] Streamline unique id generation (#29375) · db290610
  Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  db290610
- [Bugfix] If chunked_prefill is disabled, end the scheduling early. (#28911) · 67fc16cd
  wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  67fc16cd
- [Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) · 6330f947
  elvischenv authored Nov 25, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  6330f947
- [ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367) · ef1f7030
  Micah Williamson authored Nov 25, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  ef1f7030
- EAGLE Support DP>1 (#26086) · 12c007e2
  Rémi Delacourt authored Nov 25, 2025
```
Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Signed-off-by: remi <remi@mistral.ai>
```
  12c007e2
- [Perf] use cpu all reduce to avoid sync when async_scheduling & dp > 1 (#29311) · f242cfcd
  zhrrr authored Nov 25, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  f242cfcd
- Allow oot custom compiler extension via CompilerInterface (#28623) · 888152bf
  Icey authored Nov 25, 2025
```
Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Icey <1790571317@qq.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
```
  888152bf
- [fix][cpu] Use a SwigluOAI impl which supports interleaved gate-up wei (#29273) · 98caeadd
  Fadi Arafeh authored Nov 25, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  98caeadd
- [Bugfix] [ROCm] [UX]: revert Flex attention backend (#29371) · 64deead7
  vllmellm authored Nov 25, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  64deead7
- [BugFix] Use unique ids for different transcription prompts (#29372) · 7992324f
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7992324f
- Fix PoolingParams.skip_reading_prefix_cache type (#29364) · ce58fdc1
  kflu authored Nov 24, 2025
```
Signed-off-by: KFL <kludev@gmail.com>
```
  ce58fdc1
- Scheduled removal of `guided_*` config fields (#29326) · 316c8492
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  316c8492
- [CI/Test Fix] Fix CP tests on Blackwell (#29338) · 2d9ee28c
  Lucas Wilkinson authored Nov 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  2d9ee28c
- [Attention] add `_cudagraph_support` for linear attention (#28934) · 81db702e
  Jiangyun Zhu authored Nov 25, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  81db702e
- [Model] Add HunyuanOCR support (#29327) · 92effb07
  Isotr0py authored Nov 25, 2025
```
Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  92effb07
- [Bugfix] Make deprecated `--task embedding` consistent with `--runner… (#29312) · 87185c88
  Maryam Tahhan authored Nov 25, 2025
```
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
```
  87185c88
- [Metrics] Scheduled removal of deprecated metrics (#29330) · 9cf4edae
  Mark McLoughlin authored Nov 25, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  9cf4edae
- [ROCm][MLA] enable fp8 MLA decode on ROCm (#28032) · cb7214d8
  gbyu-amd authored Nov 25, 2025
```
Signed-off-by: guanbao <gyu@amd.com>
Signed-off-by: Guanbao Yu <gyu@amd.com>
Signed-off-by: gbyu-amd <Guanbao.Yu@amd.com>
Co-authored-by: guanbao <gyu@amd.com>
```
  cb7214d8
- [Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for... · 77e10c9c
  Pleaplusone authored Nov 25, 2025
```
[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029)
Signed-off-by: ganyi <ygan@amd.com>
```
  77e10c9c
- [Perf] Disable DeepGEMM MoE by default when TP=8 is used (#29346) · 6f1355a1
  Michael Goin authored Nov 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6f1355a1
- Scheduled removal of `ParallelConfig`'s direct child EPLB fields (#29324) · a4ad43ad
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a4ad43ad