Commits · 91be5f9be3e5bf44fd00b696bf47f0e41edae3bf · OpenDAS / vllm_cscc

19 Mar, 2026 3 commits
- [MoE Refactor] Rename "naive" all2all backend (#36294) · 91be5f9b
  bnellnm authored Mar 19, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  91be5f9b
- [torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid... · 7769b583
  Lucas Kabela authored Mar 19, 2026
```
[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid cache conflict (#37345)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  7769b583
- [Misc] Cleanup more configs and processors (#37560) · 657855ab
  Cyrus Leung authored Mar 19, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  657855ab
18 Mar, 2026 4 commits

[Log] Reduce duplicate log (#37313) · c373b5c0
Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
c373b5c0
elastic_ep: Fix stateless group port races (#36330) · de1a86b7
Itay Alroy authored Mar 18, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
de1a86b7

[Hardware][TPU] Add supports_async_scheduling() method to Executor interface... · a0dd1995

gxd3 authored Mar 17, 2026


[Hardware][TPU] Add supports_async_scheduling() method to Executor interface so that it can be extended for Executor implementations. (#36924)
Signed-off-by: Guangxiang Du <gxd@google.com>

a0dd1995

[Performance] Add --enable-ep-weight-filter CLI option (#37351) · 761e0aa7

Roy Wang authored Mar 18, 2026


Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

761e0aa7

17 Mar, 2026 2 commits
- [Deprecation] Deprecate `--calculate-kv-scales` option (#37201) · e78821b4
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e78821b4
- [Misc][LoRA] Add --lora-target-modules to restrict LoRA to specific modules (#34984) · 3717a4dd
  Bhoomit authored Mar 17, 2026
```
Signed-off-by: Bhoomit Vasani <bhoomit.2010@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3717a4dd
16 Mar, 2026 4 commits

[Misc] Add `float16` to `CacheDType` (#37199) · 93f3c8e5
Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
93f3c8e5

[Bugfix] Add safety check and fallback for null scaling factor (#36106) · 8d8855fd

Yuanheng Zhao authored Mar 16, 2026

Signed-off-by: Yuanheng Zhao <jonathan.zhaoyh@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

8d8855fd

[Performance] Add prefetch for checkpoints to OS page cache (#36012) · f5e59ee7
Artem Perevedentsev authored Mar 16, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
f5e59ee7

[Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b

leo-cf-tian authored Mar 16, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>

2754231b

15 Mar, 2026 1 commit
- [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) · a3e2e250
  Hari authored Mar 15, 2026
```
Signed-off-by: hasethuraman <hsethuraman@microsoft.com>
```
  a3e2e250
14 Mar, 2026 1 commit
- [Feature] Add InstantTensor weight loader (#36139) · 8c29042b
  arlo authored Mar 15, 2026
  
  8c29042b
13 Mar, 2026 5 commits
- [Bugfix] Fix DeepSeek-V3.2 tokenizer stripping spaces (#37004) · 9efc4db9
  Matthew Bonanni authored Mar 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  9efc4db9
- [Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666) · 7afe0faa
  Mark McLoughlin authored Mar 13, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  7afe0faa
- [Misc] Set default `kv_buffer_device` in a better way (#36862) · 5a3f1eb6
  Harry Mellor authored Mar 13, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5a3f1eb6
- [2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627) · d5af196c
  Itay Alroy authored Mar 13, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
  d5af196c
- [Model Runner V2] Some code simplification (#36929) · cd32d6f5
  Nick Hill authored Mar 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  cd32d6f5
12 Mar, 2026 1 commit
- [Attention] Use FA4 for MLA prefill (#34732) · f444c05c
  Matthew Bonanni authored Mar 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f444c05c
11 Mar, 2026 6 commits
- [Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461) · c77181e5
  Giancarlo Delfin authored Mar 11, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c77181e5
- [BugFix]: add bagel to MM_PREFIX_LM_MODELS (#36316) · ff1e3d9c
  汪志鹏 authored Mar 12, 2026
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  ff1e3d9c
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- Kimi k2.5 MLA based eagle3 (#36361) · 55738947
  Jhao-Ting Chen authored Mar 11, 2026
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
```
  55738947
- Disable cascade attention by default (#36318) · 9c34e9d2
  Michael Goin authored Mar 11, 2026
  
  9c34e9d2
- [Hardware][NIXL] set default kv buffer type for different platform (#36438) · f22d6e02
  liuzhenwei authored Mar 11, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f22d6e02
10 Mar, 2026 3 commits
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
- [Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628) · 23486039
  Mark McLoughlin authored Mar 10, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  23486039
- Remove unused disable_fallback field (#36546) · 04b67d8f
  Zhuohan Li authored Mar 09, 2026
  
  04b67d8f
09 Mar, 2026 4 commits

[MRV2] Extensible CG dispatch rework (#35959) · 483463f7
Lucas Wilkinson authored Mar 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
483463f7

[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027) · 4b87ffbe

Copilot authored Mar 09, 2026

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4b87ffbe

Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
77a73458
[Bugfix] Skip out-of-stage layers in get_layers_from_vllm_config for pipeline parallel (#36243) · c4d859c2
Tushar Shetty authored Mar 09, 2026
```
Signed-off-by: Tushar Shetty <tushar.shetty@abbyy.com>
Signed-off-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
```
c4d859c2

07 Mar, 2026 2 commits
- [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) · a6be75db
  PatchyTIS authored Mar 08, 2026
  
  a6be75db
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 3 commits

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
27066d1b

[Feature] Add --distributed-timeout-seconds CLI option (#36047) · 03a49bb8

Shiyan Deng authored Mar 05, 2026


Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

03a49bb8

05 Mar, 2026 1 commit
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd