Commits · ca6a95ba259aaa4c89eccdd254fa7922e31eddc2 · OpenDAS / vllm_cscc

24 Dec, 2025 1 commit
- [Chore] Simplify logic of `_execute_mm_encoder` (#31222) · ca6a95ba
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca6a95ba
23 Dec, 2025 5 commits
- [Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686
  Mark McLoughlin authored Dec 23, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f7900686
- [Mamba] - Consolidate Mambas Attention Logic (#28133) · 34916ae3
  Asaf Joseph Gardin authored Dec 23, 2025
  
  34916ae3
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
- Correct position of docstring of class attributes (#31209) · 73cfb7a7
  Weida Hong authored Dec 23, 2025
```
Signed-off-by: Weida Hong <wdhongtw@google.com>
```
  73cfb7a7
- Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3e102623
22 Dec, 2025 6 commits
- [Perf] Remove blocking copy in GDN Attention (#31167) · 85aff45e
  Benjamin Chislett authored Dec 22, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  85aff45e
- [Bug] Fix `'CutlassMLAImpl' object has no attribute '_workspace_buffer'` (#31173) · 5312a728
  Wentao Ye authored Dec 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5312a728
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8
- [UX] improve profiler error message (#31125) · 8dd0db68
  Boyuan Feng authored Dec 22, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  8dd0db68
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
20 Dec, 2025 1 commit
- [Bugfix] Read truncate_prompt_tokens from pooling_params in AsyncLLM.encode() (#31013) · 1501a407
  Jeffrey Wang authored Dec 20, 2025
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  1501a407
19 Dec, 2025 4 commits
- [BugFix] Fix TypeError: unhashable type: 'dict' when serving deepseek32 (#30924) · 5f6477d1
  Lucas Wilkinson authored Dec 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5f6477d1
- Make engine core client handshake timeout configurable (#27444) · 1ab52135
  Seiji Eicher authored Dec 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  1ab52135
- [BugFix] Fix logprobs with spec decode and modified logits (#30846) · 2ac85a45
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ac85a45
- [BugFix] Handle errors when preprocessing added requests (#30895) · 45c0526a
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  45c0526a
18 Dec, 2025 10 commits
- [Cleanup] Refactor FlashInferMetadataBuilder (#29128) · d6b3d39b
  Benjamin Chislett authored Dec 18, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d6b3d39b
- [BugFix] Fix spec decode + structured outputs + preemption edge case (#30916) · b0b77c46
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b0b77c46
- [BugFix] Spec decode with VLLM_ENABLE_V1_MULTIPROCESSING=0 (#30319) · 24b65eff
  Chen Zhang authored Dec 18, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  24b65eff
- [BugFix] Add sleep to fix tight loop and release GIL (#29476) · 62be3670
  Alec authored Dec 18, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  62be3670
- [Cleanup] Remove unused ModelRunner V1 `InputBatch.num_tokens` field (#30218) · 686cbaac
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  686cbaac
- [ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with... · be2ad5f9
  Andreas Karatzas authored Dec 18, 2025
```
[ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with patternProperties (#30730)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  be2ad5f9
- [Fix][FlexAttention] return max logical block index to handle reused blocks (#30915) · 11a89cf9
  Yifan Qiao authored Dec 17, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  11a89cf9
- [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) · fd8afdf3
  Micah Williamson authored Dec 17, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  fd8afdf3
- [Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9
  SungMinCho authored Dec 17, 2025
```
Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  a0b782f9
- [v1] Add PrefixLM support to TritonAttention backend (#30386) · 74a1ac38
  Isotr0py authored Dec 18, 2025
  
  74a1ac38
17 Dec, 2025 4 commits
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
- [Chore] Factor out logic for requesting initial memory (#30868) · 2497228a
  Cyrus Leung authored Dec 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2497228a
- [Fix] uniform decode batch check (#30747) · 6e9dbcc5
  Jialin Ouyang authored Dec 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  6e9dbcc5
- Fix lazy import (#30858) · fb980eb2
  Harry Mellor authored Dec 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb980eb2
16 Dec, 2025 8 commits
- [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
  Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
  f5f51e59
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
- Update where `bytes_to_unicode` is imported from (#30771) · e1625498
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e1625498
- [BugFix] Fix memory spike in workspace allocation (#30744) · 00a8d762
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  00a8d762
- [Bugfix] Whisper fix number of allocated CrossAttn blocks per-request (#30772) · 75eb302a
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  75eb302a
- [ROCm][MTP] Support MTP for AITER MLA backend (#28624) · 9dbbc59b
  Pleaplusone authored Dec 16, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  9dbbc59b
- [Bugfix] Fix RequestOutput miss lora_request (#30636) · 0e391e75
  Jee Jee Li authored Dec 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0e391e75
- [feature] extend DBO to XBO (#30120) · b9ff4f2a
  jiangkuaixue123 authored Dec 16, 2025
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
```
  b9ff4f2a
15 Dec, 2025 1 commit

Update batch invariant to use attention config (#30704) · 60dbf7d8

Matthew Bonanni authored Dec 15, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

60dbf7d8