Commits · d5af196c183bef2e886c7ec12db63b6161cacfde · OpenDAS / vllm_cscc

13 Mar, 2026 2 commits

[2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627) · d5af196c

Itay Alroy authored Mar 13, 2026


Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

d5af196c

[Model Runner V2] Some code simplification (#36929) · cd32d6f5
Nick Hill authored Mar 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
cd32d6f5

12 Mar, 2026 1 commit
- [Attention] Use FA4 for MLA prefill (#34732) · f444c05c
  Matthew Bonanni authored Mar 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f444c05c
11 Mar, 2026 6 commits
- [Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461) · c77181e5
  Giancarlo Delfin authored Mar 11, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c77181e5
- [BugFix]: add bagel to MM_PREFIX_LM_MODELS (#36316) · ff1e3d9c
  汪志鹏 authored Mar 12, 2026
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  ff1e3d9c
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- Kimi k2.5 MLA based eagle3 (#36361) · 55738947
  Jhao-Ting Chen authored Mar 11, 2026
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
```
  55738947
- Disable cascade attention by default (#36318) · 9c34e9d2
  Michael Goin authored Mar 11, 2026
  
  9c34e9d2
- [Hardware][NIXL] set default kv buffer type for different platform (#36438) · f22d6e02
  liuzhenwei authored Mar 11, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f22d6e02
10 Mar, 2026 3 commits
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
- [Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628) · 23486039
  Mark McLoughlin authored Mar 10, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  23486039
- Remove unused disable_fallback field (#36546) · 04b67d8f
  Zhuohan Li authored Mar 09, 2026
  
  04b67d8f
09 Mar, 2026 4 commits

[MRV2] Extensible CG dispatch rework (#35959) · 483463f7
Lucas Wilkinson authored Mar 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
483463f7

[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027) · 4b87ffbe

Copilot authored Mar 09, 2026

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4b87ffbe

Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
77a73458
[Bugfix] Skip out-of-stage layers in get_layers_from_vllm_config for pipeline parallel (#36243) · c4d859c2
Tushar Shetty authored Mar 09, 2026
```
Signed-off-by: Tushar Shetty <tushar.shetty@abbyy.com>
Signed-off-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
```
c4d859c2

07 Mar, 2026 2 commits
- [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) · a6be75db
  PatchyTIS authored Mar 08, 2026
  
  a6be75db
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 3 commits

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
27066d1b

[Feature] Add --distributed-timeout-seconds CLI option (#36047) · 03a49bb8

Shiyan Deng authored Mar 05, 2026


Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

03a49bb8

05 Mar, 2026 5 commits
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  71963481
- [Docs] Update `CacheConfig` block_size docstring to remove inaccurate limit... · e2b31243
  Seiji Eicher authored Mar 04, 2026
```
[Docs] Update `CacheConfig` block_size docstring to remove inaccurate limit when using CUDA (#35632)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  e2b31243
- [Misc] Remove deprecated items that are due for removal (#36006) · c3598d02
  Martin Hickey authored Mar 05, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  c3598d02
04 Mar, 2026 5 commits
- [CI] Bump `mypy` version (#34950) · 17dc9c7f
  Harry Mellor authored Mar 04, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  17dc9c7f
- Add PyTorch profiler schedule support with warmup/active iterations (#35240) · 7eca8591
  fenypatel99 authored Mar 04, 2026
  
  7eca8591
- [Misc] Add `--attention-backend auto` option (#35738) · 18e01a0a
  Nicolò Lucchesi authored Mar 04, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  18e01a0a
- [Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109
  sungsoo ha authored Mar 04, 2026
```
Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6cb90109
- [Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
  haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d6e04f4c
02 Mar, 2026 4 commits
- [KVConnector] Auto-downgrade to PIECEWISE cudagraph mode for layerwise async ops (#31057) · a13d8c03
  Yashwant Bezawada authored Mar 02, 2026
```
Signed-off-by: Yashwant Bezawada <yashwant_b@me.com>
```
  a13d8c03
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
- [Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308
  ElizaWszola authored Mar 02, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  d9c77308
- [Misc] Cleanup useless `current_platform` import (#35715) · 510bc9e1
  wangxiyuan authored Mar 02, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  510bc9e1
01 Mar, 2026 2 commits

[Attention] FA4 integration (#32974) · 8b5014d3

Lucas Wilkinson authored Mar 01, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

8b5014d3

[torch.compile] Undo the fast_moe_cold_start hack in torch>=2.11 (#35475) · e82fbeec
Richard Zou authored Mar 01, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
e82fbeec

28 Feb, 2026 2 commits

[EPLB] Enforce sync eplb for NCCL-based all2all backend (#35212) · b2d8b422
Ilya Markov authored Feb 28, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
b2d8b422

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

27 Feb, 2026 1 commit

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171) · 2ce6f3cf

Aaron Hao authored Feb 27, 2026


Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2ce6f3cf