Commits · 6dc9491406938463e44e631610ce83df1d20f8cd · OpenDAS / vllm_cscc

15 Apr, 2026 2 commits

[SpecDecode][Benchmark] Add SPEED-bench support to benchmarking CLI (#36029) · 3cc328a4
Talor Abramovich authored Apr 15, 2026
```
Signed-off-by: talora <talora@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
3cc328a4

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

14 Apr, 2026 2 commits

[MoE] Move GPT OSS Triton kernel experts into fused_moe/experts/ (#39007) · 1a9353bb

Jackmin801 authored Apr 14, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

1a9353bb

[MM][Perf][CG] Support ViT full CUDA graph for Qwen3-VL video inference (#38061) · 80118853

Shanshan Shen authored Apr 14, 2026


Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

80118853

13 Apr, 2026 3 commits

[Doc] Fix Python-only build 404 fallback guidance (#38052) · 610a3efc

Yuyi Ao authored Apr 13, 2026

Signed-off-by: George-ao <yuyiao772@gmail.com>
Signed-off-by: Yuyi Ao <yuyiao772@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

610a3efc

[Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604) · 739e5945
Yongye Zhu authored Apr 13, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
739e5945

feat: rename logit_bias/logit_scale to logit_mean/logit_sigma for affine score calibration (#39530) · fa6ae311

Jesus Federico authored Apr 13, 2026


Signed-off-by: Jesus Federico <jefp@amazon.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

fa6ae311

12 Apr, 2026 1 commit

[KVConnector][NIXL] Organize NIXL connector into its own directory (#39354) · 3244a2eb

Nicolò Lucchesi authored Apr 12, 2026



The number of features supported by the connector has grown substantially
and the `nixl_connector.py` file has accumulated a lot of code. Creates a separate
directory and isolates connector/scheduler code in the hope of improving clarity
and maintainability.

Further refactor of components aimed at improving clarity and simplifying code
will follow soon.
Signed-off-by: NickLucche <nlucches@redhat.com>

3244a2eb

10 Apr, 2026 9 commits
- [Docs] Use `--torch-backend=auto` for editable install docs (#39511) · 7f0b8f20
  Michael Goin authored Apr 11, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  7f0b8f20
- Add structure to `requirements/` directory (#39024) · fc645f1a
  Harry Mellor authored Apr 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  fc645f1a
- feat: add logit_scale to PoolerConfig for affine score calibration (#39435) · b87575d2
  Jesus Federico authored Apr 10, 2026
```
Signed-off-by: Jesus Federico <jefp@amazon.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  b87575d2
- [New Model]: jinaai/jina-reranker-v3 (#38800) · cb5f7501
  wang.yuqi authored Apr 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  cb5f7501
- [Model] Implement LoRA support for Qwen3ASRForConditionalGeneration (#37247) · 8d0f908b
  Peter Nguyen authored Apr 10, 2026
```
Signed-off-by: Peter Nguyen <petern0408@gmail.com>
```
  8d0f908b
- [model] support FireRedLID (#39290) · 967146e7
  PatchyTIS authored Apr 10, 2026
```
Signed-off-by: PatchouliTaisa <patchychen@tencent.com>
Co-authored-by: PatchouliTaisa <patchychen@tencent.com>
```
  967146e7
- update CODEOWNERS file (#39439) · 65e4e46f
  Chendi.Xue authored Apr 10, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  65e4e46f
- Add EXAONE-4.5 (#39388) · e7a1387e
  Kyungmin Lee authored Apr 10, 2026
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  e7a1387e
- [Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214) · ecbfbb8d
  Chauncey authored Apr 10, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  ecbfbb8d
09 Apr, 2026 2 commits

[Docs] Bring README updates into docs README (#39397) · d87fb264
Harry Mellor authored Apr 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d87fb264

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) · eb4205fe

Michael Goin authored Apr 09, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

eb4205fe

08 Apr, 2026 5 commits

[MoE] Move DEEP_GEMM into experts/ subdirectory (#39005) · a776a48b

Jackmin801 authored Apr 08, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a776a48b

[Feature] NUMA binding support for GPU workers (#38635) · 75e01a39

Shengqi Chen authored Apr 09, 2026


Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

75e01a39

[Bugfix][Docs] Fix ReadTheDocs build crash from mocked torch decorator (#39284) · 6155bbd1
Kevin H. Luu authored Apr 08, 2026
```
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
6155bbd1
[Docs] Add Phi-4-reasoning-vision to supported models + examples (#39232) · 7b80cd8a
Varun Sundar Rabindranath authored Apr 07, 2026
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
7b80cd8a
[release 2.11] Update to torch 2.11 (#34644) · 2111997f
Andrey Talman authored Apr 07, 2026

2111997f

07 Apr, 2026 2 commits
- Automatically add links to API docs for matching strings in docs (#37434) · 79df4a79
  Harry Mellor authored Apr 07, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  79df4a79
- [MoE Refactor] Split up compressed_tensors_moe.py (#38960) · b2b2c523
  bnellnm authored Apr 06, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  b2b2c523
06 Apr, 2026 1 commit

[Model] Add support for BharatGen's Param2MoE model (#38000) · c5e3454e

bhargav-patel-29 authored Apr 06, 2026


Signed-off-by: bhargav-patel-29 <bhargav.patel@tihiitb.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c5e3454e

03 Apr, 2026 2 commits

[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) · 1f5ec288

Carl Y authored Apr 02, 2026

Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

1f5ec288

[New Model]: add support for telechat3 (#38510) · 71a9125c

1096125073 authored Apr 03, 2026


Signed-off-by: xiayongqiang <xiayq1@chinatelecom.cn>
Co-authored-by: xiayongqiang <xiayq1@chinatelecom.cn>

71a9125c

02 Apr, 2026 2 commits

[Model] Add support for Cheers multimodal model (#38788) · c0817e4d

bsliu authored Apr 02, 2026


Signed-off-by: bsliu <1187291748@qq.com>
Signed-off-by: 吴炳贤 <wubingxian24@mails.ucas.ac.cn>

c0817e4d

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378) · 2ce3d0ce

JartX authored Apr 02, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yangyang4991 <yangyang4991@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2ce3d0ce

01 Apr, 2026 5 commits
- [Bugfix] Restrict TRTLLM attention to SM100, fixing GB300 (SM103) hang (#38730) · 6183cae1
  Stefano Castagnetta authored Apr 01, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
  6183cae1
- Feature/silu block quant fusion v1 (#32996) · c09ad767
  Monishver authored Apr 01, 2026
```
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
```
  c09ad767
- [Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242) · cbe7d180
  Chauncey authored Apr 02, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  cbe7d180
- Add ibm-granite/granite-vision-3.3-2b to supported models documentation (#38714) · 148c2072
  Jesus Talavera authored Apr 01, 2026
```
Signed-off-by: Jesus Talavera <jesus.talavera@ibm.com>
```
  148c2072
- [CPU] Support head_size 512 in cpu_attn (#38676) · 36d7f198
  Li, Jiang authored Apr 01, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  36d7f198
31 Mar, 2026 4 commits

Generative Scoring (#34539) · 2e569756

Vedant V Jhaveri authored Mar 31, 2026


Signed-off-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2e569756

[torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
077a9a8e
[Docs] PD with Nixl compat matrix (#38628) · 7337ff7f
Nicolò Lucchesi authored Mar 31, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
7337ff7f
[Mypy] Fix adjust_request typing (#38264) · 3e802e87
Flora Feng authored Mar 31, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
3e802e87