Commits · e0613702ade9ace874feabb7b6f080cdfd181f4b · OpenDAS / vllm_cscc

01 Apr, 2026 1 commit
- [Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242) · cbe7d180
  Chauncey authored Apr 02, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cbe7d180
31 Mar, 2026 2 commits
- [Docs] PD with Nixl compat matrix (#38628) · 7337ff7f
  Nicolò Lucchesi authored Mar 31, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  7337ff7f
- [Mypy] Fix adjust_request typing (#38264) · 3e802e87
  Flora Feng authored Mar 31, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  3e802e87
25 Mar, 2026 1 commit
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
24 Mar, 2026 1 commit

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

23 Mar, 2026 1 commit
- update doc for online fp8 quantization (#37851) · d3fe8571
  Yan Ma authored Mar 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  d3fe8571
19 Mar, 2026 2 commits

Remove deprecated reasoning_content message field(part-2) (#37480) · 104605cb

Ifta khairul Alam Adil authored Mar 19, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Philip Ottesen <phiott256@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
Signed-off-by: sihao.li <sihao.li@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Philip Ottesen <phiott256@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Thillai Chithambaram <79466435+thillai-c@users.noreply.github.com>
Co-authored-by: sihao_li <165983188+1643661061leo@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

104605cb

[Docs] Reorganize pooling docs. (#35592) · f9e2a383

wang.yuqi authored Mar 19, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

f9e2a383

17 Mar, 2026 1 commit

[Misc][LoRA] Add --lora-target-modules to restrict LoRA to specific modules (#34984) · 3717a4dd

Bhoomit authored Mar 17, 2026


Signed-off-by: Bhoomit Vasani <bhoomit.2010@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

3717a4dd

16 Mar, 2026 2 commits
- [Doc] Clarify schema enforcement behavior for tool_choice modes (#37064) · 31a458c0
  Yuchen Fama authored Mar 16, 2026
```
Signed-off-by: yfama <yuchengu@gmail.com>
```
  31a458c0
- Add simple granite4 tool parser (#36827) · 9f9ecff4
  Max de Bayser authored Mar 16, 2026
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  9f9ecff4
12 Mar, 2026 1 commit
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
09 Mar, 2026 1 commit
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
06 Mar, 2026 1 commit
- docs: fix wrong cc in int8.md (#36209) · e68de8ad
  Xiang Shi authored Mar 06, 2026
```
Signed-off-by: Xiang Shi <realkevin@tutanota.com>
```
  e68de8ad
05 Mar, 2026 1 commit

[Doc] Add Parallel Draft Models (#35973) · d106bf39

zihaoanllm authored Mar 05, 2026



Signed-off-by: <zihaoan2@amd.com>
Signed-off-by: zihaoanllm <zihaoan2@amd.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

d106bf39

04 Mar, 2026 3 commits
- [Docs] Clarify structured outputs configuration for Qwen3 reasoning mode (#32441) · 138d891d
  Davina Zaman authored Mar 04, 2026
```
Signed-off-by: Davina Zaman <davzaman@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  138d891d
- [Docs] Upgrade dynamic LoRA warning to admonition block (#35218) · 2f2c1d73
  Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  2f2c1d73
- [Doc] Add MTP docs and update speculative decoding guidance (#35197) · 7cc6058a
  Xing Liu authored Mar 05, 2026
```
Signed-off-by: liuxing <945764858@qq.com>
```
  7cc6058a
24 Feb, 2026 1 commit
- [MM] Allow audio chunking for offline LLM (#34628) · f91808ae
  Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f91808ae
21 Feb, 2026 3 commits
- [Doc] Fix example of eagle3 (#34960) · bebfe55b
  petrpechman authored Feb 21, 2026
```
Signed-off-by: Petr Pechman <petr.pechman@firma.seznam.cz>
Co-authored-by: Petr Pechman <petr.pechman@firma.seznam.cz>
```
  bebfe55b
- [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
  Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ab6f3487
- [ROCm] Enable bitsandbytes quantization support on ROCm (#34688) · 8dc8a99b
  BADAOUI Abdennacer authored Feb 21, 2026
```
Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>
```
  8dc8a99b
18 Feb, 2026 1 commit
- [Docs] Clean up speculators docs (#34065) · 64ac1395
  Kyle Sayers authored Feb 18, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  64ac1395
16 Feb, 2026 2 commits
- Bump `lm-eval` version for Transformers v5 compatibility (#33994) · a21cedf4
  Harry Mellor authored Feb 16, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a21cedf4
- [Doc] Add Mistral-7b-v0.3 model to the batch invariance validated model (#34584) · 56530210
  Parth Bansal authored Feb 16, 2026
```
Signed-off-by: Parth Bansal <parthbansal127@gmail.com>
```
  56530210
12 Feb, 2026 1 commit
- [Docs] Spec decoding docs warning removal (#34439) · 334c715e
  Nicolò Lucchesi authored Feb 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  334c715e
11 Feb, 2026 1 commit
- [Doc] Update Marlin support matrix for Turing (#34319) · 786806dd
  Tianqi Ren authored Feb 11, 2026
```
Signed-off-by: Tianqi Ren <tianqi.r@outlook.com>
```
  786806dd
10 Feb, 2026 1 commit
- [Doc] Update usage of `--limit-mm-per-prompt` (#34148) · 25e48a3a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  25e48a3a
09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
08 Feb, 2026 1 commit
- Add support for ModelOpt MXFP8 dense models (#33786) · 084aa19f
  danisereb authored Feb 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  084aa19f
05 Feb, 2026 1 commit

Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) · 8322d4e4

liranschour authored Feb 05, 2026


Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

8322d4e4

04 Feb, 2026 1 commit
- [Feature] Enable `TRITON_ATTN` for Batch Invariance (#33688) · 45f8fd6f
  Frank Wang authored Feb 03, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
```
  45f8fd6f
03 Feb, 2026 2 commits
- [P/D] rework mooncake connector and introduce its bootstrap server (#31034) · 0d6ccf68
  dtc authored Feb 04, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  0d6ccf68
- Document NixlConnector backend selection via kv_connector_extra_config (#33552) · 2df2b349
  Krish Gupta authored Feb 03, 2026
```
Signed-off-by: KrxGu <krishom70@gmail.com>
```
  2df2b349
31 Jan, 2026 1 commit
- [UX] Use gguf `repo_id:quant_type` syntax for examples and docs (#33371) · 29fba767
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  29fba767
29 Jan, 2026 1 commit

[Docs] Adding links and intro to Speculators and LLM Compressor (#32849) · 13376576

Aidan Reilly authored Jan 29, 2026

Signed-off-by: Aidan Reilly <aireilly@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

13376576

28 Jan, 2026 2 commits

Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241) · 2e8de867
Or Ozeri authored Jan 28, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
2e8de867

[Quantization][Deprecation] Remove BitBlas (#32683) · 247d1a32

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

247d1a32

26 Jan, 2026 2 commits
- [Misc] HF Hub LoRA Resolver (#20320) · 9ac818a5
  Alex Brooks authored Jan 26, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9ac818a5
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687