Commits · f4b42df04847dcbd3247f7f4c56dff45e40bdf0d · OpenDAS / vllm_cscc

"tests/entrypoints/pooling/llm/test_encode.py" did not exist on "57e729e87478d734e8d0075e35aeb4c9bd440e77"

15 Apr, 2026 1 commit

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

14 Apr, 2026 2 commits
- [Mamba] Flashinfer selective_state_update (#36162) · ecf5ff7c
  roikoren755 authored Apr 14, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  ecf5ff7c
- [MoE Refactor] Remove MoE DP chunking (#39107) · e1e318af
  bnellnm authored Apr 14, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  e1e318af
10 Apr, 2026 1 commit
- [Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214) · ecbfbb8d
  Chauncey authored Apr 10, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  ecbfbb8d
08 Apr, 2026 1 commit

[Feature] NUMA binding support for GPU workers (#38635) · 75e01a39

Shengqi Chen authored Apr 09, 2026


Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

75e01a39

03 Apr, 2026 1 commit
- [Frontend] new online quantization frontend (#38138) · 7b1a7423
  Vasiliy Kuznetsov authored Apr 03, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  7b1a7423
01 Apr, 2026 1 commit

[vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825) · 40bb1750

Luka Govedič authored Mar 31, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>

40bb1750

30 Mar, 2026 1 commit
- [Mamba] Add stochastic rounding support (#35753) · 8e6293e8
  roikoren755 authored Mar 30, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  8e6293e8
27 Mar, 2026 3 commits
- Add short flag `-sc` for `--speculative-config` argument (#38380) · 7ba425e9
  Michael Goin authored Mar 27, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  7ba425e9
- enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
  Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  98e7f223
- [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
  Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  999dfc16
25 Mar, 2026 2 commits
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
- [Performance] Auto-enable prefetch on NFS with RAM guard (#37673) · a93a53f8
  Artem Perevedentsev authored Mar 25, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  a93a53f8
24 Mar, 2026 3 commits

[Bugfix] Pass hf_token through config loading paths for gated model support (#37920) · 54b0578a
Javier De Jesus authored Mar 24, 2026
```
Signed-off-by: javierdejesusda <javier.dejesusj9@gmail.com>
```
54b0578a

[Core] add option to schedule requests based on full ISL (#37307) · dc78c2c9

Dan Blanaru authored Mar 24, 2026


Signed-off-by: Dan Blanaru <48605845+DanBlanaru@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>

dc78c2c9

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

23 Mar, 2026 1 commit
- [Mypy] Fix mypy for `vllm/config` (#37808) · 45bd5c8e
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  45bd5c8e
21 Mar, 2026 1 commit

Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884

Brandon Pelfrey authored Mar 21, 2026


Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

80b70884

18 Mar, 2026 2 commits
- Add API docs link if the CLI arg is a config class (#37432) · 39bfb57b
  Harry Mellor authored Mar 18, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  39bfb57b
- [Performance] Add --enable-ep-weight-filter CLI option (#37351) · 761e0aa7
  Roy Wang authored Mar 18, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  761e0aa7
17 Mar, 2026 1 commit

[Misc][LoRA] Add --lora-target-modules to restrict LoRA to specific modules (#34984) · 3717a4dd

Bhoomit authored Mar 17, 2026


Signed-off-by: Bhoomit Vasani <bhoomit.2010@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

3717a4dd

15 Mar, 2026 1 commit
- [GDN] add a config for gdn kernel selection (#36647) · 697e4ff3
  Jiangyun Zhu authored Mar 16, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  697e4ff3
13 Mar, 2026 1 commit

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666) · 7afe0faa

Mark McLoughlin authored Mar 13, 2026


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

7afe0faa

10 Mar, 2026 1 commit
- [Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628) · 23486039
  Mark McLoughlin authored Mar 10, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  23486039
09 Mar, 2026 2 commits
- [Misc] fix typo: dependant -> dependent (2 lines change) (#36511) · 55d27cca
  SoluMilken authored Mar 10, 2026
```
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
```
  55d27cca
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
07 Mar, 2026 1 commit
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 2 commits
- [Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
  Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  27066d1b
- [Feature] Add --distributed-timeout-seconds CLI option (#36047) · 03a49bb8
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  03a49bb8
04 Mar, 2026 2 commits

[Misc] Add `--attention-backend auto` option (#35738) · 18e01a0a
Nicolò Lucchesi authored Mar 04, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
18e01a0a

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

02 Mar, 2026 1 commit
- [Doc] Improve UX of `--enable-log-requests` (#35723) · 792a74b9
  Cyrus Leung authored Mar 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  792a74b9
28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

26 Feb, 2026 4 commits
- [Hardware][Powerpc]Enable prefix caching and chunked prefill for ppc64le (#35081) · e03ddcfb
  Akash kaothalkar authored Feb 26, 2026
```
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
```
  e03ddcfb
- [UX] Add `--moe-backend` arg for explicit kernel selection (#33807) · de527e1c
  Michael Goin authored Feb 25, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  de527e1c
- [UX] Add `--performance-mode {balanced,interactivity,throughput}` (#34936) · cbf8f702
  Michael Goin authored Feb 25, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cbf8f702
- [offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c
  Ming Yang authored Feb 25, 2026
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  6831650c
24 Feb, 2026 1 commit
- [CPU][Perf] Accelerate Attention head for s390x using vector intrinsics (#34434) · 34ce0ffd
  R3hankhan authored Feb 24, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  34ce0ffd
20 Feb, 2026 1 commit
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
18 Feb, 2026 1 commit
- [Attention] Refactor `check_and_update_config` (#33600) · 77431529
  Matthew Bonanni authored Feb 17, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77431529