Commits · 7d8975de84dadb87df23eae4a663a3c6620433dd · OpenDAS / vllm_cscc

"platforms/vscode:/vscode.git/clone" did not exist on "938afab08cd358e7a111bb0583f20588e9d5f37b"

16 Oct, 2025 2 commits
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
- [bugfix] Fix SP + PP without specifying compile size (#26955) · e19b16dd
  Angela Yi authored Oct 15, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  e19b16dd
15 Oct, 2025 2 commits

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
f54f8512

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 5 commits
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
- [Minor] Group async_scheduling related fields in model runner init (#26736) · ff4810ba
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ff4810ba
- [Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743) · 6d87a283
  Wentao Ye authored Oct 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6d87a283
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723) · 4497c8f8
  XiongfeiWei authored Oct 13, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  4497c8f8
13 Oct, 2025 2 commits
- [Log] Optimize Startup Log (#26601) · e251e457
  Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e251e457
- [FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
  yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
  46ad7395
12 Oct, 2025 2 commits
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [MISC] Rename the torch profiler filename as instance_id+rank_id for merging... · 76852017
  wang.yuqi authored Oct 12, 2025
```
[MISC] Rename the torch profiler filename as instance_id+rank_id for merging the Profiler results of each Rank (#25867)
Signed-off-by: wang.yuqi <noooop@126.com>
```
  76852017
11 Oct, 2025 2 commits

[Refactor]: Use M-RoPE interface directly while defining model class instead... · 727144be

dsinghvi authored Oct 11, 2025


[Refactor]: Use M-RoPE interface directly while defining model class instead of maintaining model specific M-RoPE implementation in mrope.py (#24172)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: wwl2755 <wangwenlong2755@gmail.com>

727144be

[MM] Move Qwen3Omni MRoPE impl to model file (#26608) · ddaff293

Roger Wang authored Oct 10, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddaff293

10 Oct, 2025 7 commits
- [BugFix] Make penalties and bad_words work with async scheduling (#26467) · 5bc26c43
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bc26c43
- [BugFix] Fix async scheduling + request preemption (#26385) · 949cb017
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  949cb017
- [Bugfix] Make DP padding optional in coordinate_batch_across_dp (#26375) · ae9d0e7d
  Sage Moore authored Oct 10, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  ae9d0e7d
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
- [deepseek] kernel block size for UniformTypeKVCacheSpecs (#26559) · 6f0f570c
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6f0f570c
- [Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc
  Lucas Wilkinson authored Oct 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  29255cfc
- [Core] Small simplification in `GPUModelRunner._update_states()` (#26508) · aafb99a4
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aafb99a4
09 Oct, 2025 6 commits
- [Core] Remove unused `prev_sampled_token_ids_invalid_indices` input batch field (#26514) · 2e54db4d
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2e54db4d
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
- [Misc] Misc code simplifications (#26450) · ddcbc2f3
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ddcbc2f3
- [Core] Relax the LoRA max rank (#26461) · 1b2c440c
  Jee Jee Li authored Oct 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1b2c440c
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
- Separate MLAAttention class from Attention (#25103) · e614ab78
  Naveenraj Kamalakannan authored Oct 08, 2025
```
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  e614ab78
08 Oct, 2025 1 commit

[TPU] Rename tpu_commons to tpu_inference (#26279) · 335b28f7

Utkarsh Sharma authored Oct 08, 2025


Signed-off-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

335b28f7

07 Oct, 2025 5 commits

Revert #24446 and #26168 (#26332) · 31a4b3e6
Thomas Parnell authored Oct 08, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
31a4b3e6

[V1] Logit processors for rejection sampler (#19482) · 6ebaf43e

Sergei Skvortsov authored Oct 07, 2025


Signed-off-by: southfreebird <yvorott@gmail.com>
Signed-off-by: Sergei Skvortsov <sergeyskv@nebius.com>
Signed-off-by: Sergei Skvortsov <yvorott@gmail.com>
Co-authored-by: Sergei Skvortsov <sergeyskv@nebius.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

6ebaf43e

[V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
1e4ecca1
Optimize KV cache distribution for asymmetric pipeline parallelism (#25164) · d100d78e
Grant Holmes (Ren) authored Oct 07, 2025
```
Signed-off-by: gholmes829 <g.holmes429@gmail.com>
```
d100d78e

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768) · 2111b464

Sage Moore authored Oct 06, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

2111b464

06 Oct, 2025 3 commits
- [BugFix] Pad input buffers in _dummy_run (#26209) · f23b4c04
  Varun Sundar Rabindranath authored Oct 06, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  f23b4c04
- Support llama3 eagle3 head with llama4 verifier (#25961) · 05f6846e
  Rahul Tuli authored Oct 06, 2025
```
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  05f6846e
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 3 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad