Commits · 3b312fb792d200ba4b1c3b4bf5ad06a46cd2fa1e · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "10a5f4d53d0dc7390802ad99bf5d27b2423094e9"

30 Dec, 2025 3 commits
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
- [Core] Deduplicate generate/encode logic in `AsyncLLM` (#31510) · e54ee3ea
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  e54ee3ea
- [Prefix Cache] Include lora_name in BlockStored event for deterministic... · 39512aba
  Sage authored Dec 30, 2025
```
[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Sage <80211083+sagiahrac@users.noreply.github.com>
```
  39512aba
28 Dec, 2025 1 commit
- [BugFix] Re-fix async multimodal cpu tensor race condition (#31373) · 094fcce2
  Nick Hill authored Dec 28, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  094fcce2
27 Dec, 2025 1 commit
- [Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166) · 52bf0665
  Yifan Qiao authored Dec 26, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>
```
  52bf0665
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

25 Dec, 2025 2 commits
- [BugFix] Fix async scheduling + reasoning with struct output (#31332) · 81786c87
  Nick Hill authored Dec 25, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  81786c87
- [Hybrid] Mamba2 prefix cache blocks freeing for running requests (#28047) · f1531d9f
  Stan Wozniak authored Dec 25, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  f1531d9f
24 Dec, 2025 6 commits
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [Chore] Remove unused `noqa`s (#31263) · aa3868ec
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa3868ec
- [Bugfix] Fix `max_model_len="auto"` handling (#31260) · 7adeb4bf
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7adeb4bf
- Add `--max-model-len auto` to auto-fit context to available memory (#29431) · 8ee90c83
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8ee90c83
- [KVEvent] User request.block_hash for parent block_hash (#30544) · 538e830c
  Chen Zhang authored Dec 23, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  538e830c
- [Chore] Simplify logic of `_execute_mm_encoder` (#31222) · ca6a95ba
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca6a95ba
23 Dec, 2025 5 commits
- [Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686
  Mark McLoughlin authored Dec 23, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f7900686
- [Mamba] - Consolidate Mambas Attention Logic (#28133) · 34916ae3
  Asaf Joseph Gardin authored Dec 23, 2025
  
  34916ae3
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
- Correct position of docstring of class attributes (#31209) · 73cfb7a7
  Weida Hong authored Dec 23, 2025
```
Signed-off-by: Weida Hong <wdhongtw@google.com>
```
  73cfb7a7
- Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3e102623
22 Dec, 2025 6 commits
- [Perf] Remove blocking copy in GDN Attention (#31167) · 85aff45e
  Benjamin Chislett authored Dec 22, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  85aff45e
- [Bug] Fix `'CutlassMLAImpl' object has no attribute '_workspace_buffer'` (#31173) · 5312a728
  Wentao Ye authored Dec 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5312a728
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8
- [UX] improve profiler error message (#31125) · 8dd0db68
  Boyuan Feng authored Dec 22, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  8dd0db68
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
20 Dec, 2025 1 commit
- [Bugfix] Read truncate_prompt_tokens from pooling_params in AsyncLLM.encode() (#31013) · 1501a407
  Jeffrey Wang authored Dec 20, 2025
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  1501a407
19 Dec, 2025 4 commits
- [BugFix] Fix TypeError: unhashable type: 'dict' when serving deepseek32 (#30924) · 5f6477d1
  Lucas Wilkinson authored Dec 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5f6477d1
- Make engine core client handshake timeout configurable (#27444) · 1ab52135
  Seiji Eicher authored Dec 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  1ab52135
- [BugFix] Fix logprobs with spec decode and modified logits (#30846) · 2ac85a45
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ac85a45
- [BugFix] Handle errors when preprocessing added requests (#30895) · 45c0526a
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  45c0526a
18 Dec, 2025 10 commits
- [Cleanup] Refactor FlashInferMetadataBuilder (#29128) · d6b3d39b
  Benjamin Chislett authored Dec 18, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d6b3d39b
- [BugFix] Fix spec decode + structured outputs + preemption edge case (#30916) · b0b77c46
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b0b77c46
- [BugFix] Spec decode with VLLM_ENABLE_V1_MULTIPROCESSING=0 (#30319) · 24b65eff
  Chen Zhang authored Dec 18, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  24b65eff
- [BugFix] Add sleep to fix tight loop and release GIL (#29476) · 62be3670
  Alec authored Dec 18, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  62be3670
- [Cleanup] Remove unused ModelRunner V1 `InputBatch.num_tokens` field (#30218) · 686cbaac
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  686cbaac
- [ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with... · be2ad5f9
  Andreas Karatzas authored Dec 18, 2025
```
[ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with patternProperties (#30730)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  be2ad5f9
- [Fix][FlexAttention] return max logical block index to handle reused blocks (#30915) · 11a89cf9
  Yifan Qiao authored Dec 17, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  11a89cf9
- [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) · fd8afdf3
  Micah Williamson authored Dec 17, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  fd8afdf3
- [Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9
  SungMinCho authored Dec 17, 2025
```
Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  a0b782f9
- [v1] Add PrefixLM support to TritonAttention backend (#30386) · 74a1ac38
  Isotr0py authored Dec 18, 2025
  
  74a1ac38