Commits · fde4771bbda69f86a58eace1447f3ab5e369b63d · OpenDAS / vllm_cscc

06 Mar, 2026 1 commit
- docs: fix wrong cc in int8.md (#36209) · e68de8ad
  Xiang Shi authored Mar 06, 2026
```
Signed-off-by: Xiang Shi <realkevin@tutanota.com>
```
  e68de8ad
05 Mar, 2026 1 commit

[Doc] Add Parallel Draft Models (#35973) · d106bf39

zihaoanllm authored Mar 05, 2026



Signed-off-by: <zihaoan2@amd.com>
Signed-off-by: zihaoanllm <zihaoan2@amd.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

d106bf39

04 Mar, 2026 3 commits
- [Docs] Clarify structured outputs configuration for Qwen3 reasoning mode (#32441) · 138d891d
  Davina Zaman authored Mar 04, 2026
```
Signed-off-by: Davina Zaman <davzaman@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  138d891d
- [Docs] Upgrade dynamic LoRA warning to admonition block (#35218) · 2f2c1d73
  Russell Bryant authored Mar 04, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  2f2c1d73
- [Doc] Add MTP docs and update speculative decoding guidance (#35197) · 7cc6058a
  Xing Liu authored Mar 05, 2026
```
Signed-off-by: liuxing <945764858@qq.com>
```
  7cc6058a
24 Feb, 2026 1 commit
- [MM] Allow audio chunking for offline LLM (#34628) · f91808ae
  Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f91808ae
21 Feb, 2026 3 commits
- [Doc] Fix example of eagle3 (#34960) · bebfe55b
  petrpechman authored Feb 21, 2026
```
Signed-off-by: Petr Pechman <petr.pechman@firma.seznam.cz>
Co-authored-by: Petr Pechman <petr.pechman@firma.seznam.cz>
```
  bebfe55b
- [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
  Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ab6f3487
- [ROCm] Enable bitsandbytes quantization support on ROCm (#34688) · 8dc8a99b
  BADAOUI Abdennacer authored Feb 21, 2026
```
Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>
```
  8dc8a99b
18 Feb, 2026 1 commit
- [Docs] Clean up speculators docs (#34065) · 64ac1395
  Kyle Sayers authored Feb 18, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  64ac1395
16 Feb, 2026 2 commits
- Bump `lm-eval` version for Transformers v5 compatibility (#33994) · a21cedf4
  Harry Mellor authored Feb 16, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a21cedf4
- [Doc] Add Mistral-7b-v0.3 model to the batch invariance validated model (#34584) · 56530210
  Parth Bansal authored Feb 16, 2026
```
Signed-off-by: Parth Bansal <parthbansal127@gmail.com>
```
  56530210
12 Feb, 2026 1 commit
- [Docs] Spec decoding docs warning removal (#34439) · 334c715e
  Nicolò Lucchesi authored Feb 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  334c715e
11 Feb, 2026 1 commit
- [Doc] Update Marlin support matrix for Turing (#34319) · 786806dd
  Tianqi Ren authored Feb 11, 2026
```
Signed-off-by: Tianqi Ren <tianqi.r@outlook.com>
```
  786806dd
10 Feb, 2026 1 commit
- [Doc] Update usage of `--limit-mm-per-prompt` (#34148) · 25e48a3a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  25e48a3a
09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
08 Feb, 2026 1 commit
- Add support for ModelOpt MXFP8 dense models (#33786) · 084aa19f
  danisereb authored Feb 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  084aa19f
05 Feb, 2026 1 commit

Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) · 8322d4e4

liranschour authored Feb 05, 2026


Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

8322d4e4

04 Feb, 2026 1 commit
- [Feature] Enable `TRITON_ATTN` for Batch Invariance (#33688) · 45f8fd6f
  Frank Wang authored Feb 03, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
```
  45f8fd6f
03 Feb, 2026 2 commits
- [P/D] rework mooncake connector and introduce its bootstrap server (#31034) · 0d6ccf68
  dtc authored Feb 04, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  0d6ccf68
- Document NixlConnector backend selection via kv_connector_extra_config (#33552) · 2df2b349
  Krish Gupta authored Feb 03, 2026
```
Signed-off-by: KrxGu <krishom70@gmail.com>
```
  2df2b349
31 Jan, 2026 1 commit
- [UX] Use gguf `repo_id:quant_type` syntax for examples and docs (#33371) · 29fba767
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  29fba767
29 Jan, 2026 1 commit

[Docs] Adding links and intro to Speculators and LLM Compressor (#32849) · 13376576

Aidan Reilly authored Jan 29, 2026

Signed-off-by: Aidan Reilly <aireilly@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

13376576

28 Jan, 2026 2 commits

Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241) · 2e8de867
Or Ozeri authored Jan 28, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
2e8de867

[Quantization][Deprecation] Remove BitBlas (#32683) · 247d1a32

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

247d1a32

26 Jan, 2026 2 commits
- [Misc] HF Hub LoRA Resolver (#20320) · 9ac818a5
  Alex Brooks authored Jan 26, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9ac818a5
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
25 Jan, 2026 1 commit
- [Doc] Add Qwen2.5 models to batch invariance tested models (#33016) · 151e5451
  zhanqiuhu authored Jan 25, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  151e5451
22 Jan, 2026 3 commits
- Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3
  Eldar Kurtić authored Jan 22, 2026
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  44f08af3
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
- Enable Cross layers KV cache layout at NIXL Connector (#30207) · 64e3d67a
  liranschour authored Jan 22, 2026
```
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
```
  64e3d67a
20 Jan, 2026 1 commit

[Feat] allow inplace loading lora (#31326) · 12dab78f

Jackmin801 authored Jan 19, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Jackmin801 <56836461+Jackmin801@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

12dab78f

19 Jan, 2026 1 commit

[GLM-4.7] GLM Model support for GLM-Lite (#31386) · 71832ba7

Yuxuan Zhang authored Jan 19, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Yuxuan Zhang <2448370773@qq.com>

71832ba7

14 Jan, 2026 2 commits
- [Docs] Add docs about OOT Quantization Plugins (#32035) · 6388b500
  Michael Goin authored Jan 14, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6388b500
- Consolidate Intel Quantization Toolkit Integration in vLLM (#31716) · 50632adc
  Yi Liu authored Jan 14, 2026
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  50632adc
13 Jan, 2026 2 commits
- [Docs] Nixl Usage recommend `fail` kv_load_failure_policy (#32198) · 8c8653b6
  Nicolò Lucchesi authored Jan 13, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8c8653b6
- Fix various typos found in `docs` (#32212) · f243abc9
  Andrew Bennett authored Jan 12, 2026
```
Signed-off-by: Andrew Bennett <potatosaladx@meta.com>
```
  f243abc9
12 Jan, 2026 3 commits

doc: Update model name for Qwen3-Coder in documentation (#32185) · e68b0dad
Andy Zhang authored Jan 12, 2026
```
Signed-off-by: Andy Zhang <xiazhang@microsoft.com>
```
e68b0dad
OffloadingConnector: Add cpu_bytes_to_use configuration (#24498) · 9cddbdba
Or Ozeri authored Jan 12, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
9cddbdba

[Doc] Improve LoRA docs (#32159) · 05e89812

Jee Jee Li authored Jan 12, 2026

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05e89812