Commits · 7b01d97a22c977aaad2f38fa03cd11742d2893e8 · OpenDAS / vllm_cscc

31 Mar, 2026 1 commit
- [torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
  BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  077a9a8e
20 Mar, 2026 2 commits

elastic_ep: Fix issues with repeated scale up/down cycles (#37131) · c57d38d6
Itay Alroy authored Mar 21, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
c57d38d6

fix CUDAGraph memory being counted twice (#37426) · 79eb9369

Peter Pan authored Mar 21, 2026


Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

79eb9369

17 Mar, 2026 2 commits
- [Bugfix][ROCm] Fix worker startup OOM on ROCm by skipping unreliable cudagraph... · e8f9dbc3
  JartX authored Mar 17, 2026
```
[Bugfix][ROCm] Fix worker startup OOM on ROCm by skipping unreliable cudagraph memory profiling (#36720)
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  e8f9dbc3
- [Bugfix] Fix DP MTP Dummy Run (#35243) · f63ed7b5
  Benjamin Chislett authored Mar 17, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  f63ed7b5
16 Mar, 2026 1 commit
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
12 Mar, 2026 1 commit
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
11 Mar, 2026 3 commits
- [BUG] Fix async rlhf tests (#35811) · d6b61e51
  Aaron Hao authored Mar 11, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  d6b61e51
- Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf
  Hongxin Xu authored Mar 11, 2026
```
Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  bea02cdf
- [Doc] Fix duplicate words in comments (#36713) · 4bf53362
  Hongbin Guo authored Mar 11, 2026
```
Signed-off-by: Hongbin10 <jdmjdm1998@163.com>
```
  4bf53362
10 Mar, 2026 2 commits
- [Core] Simplify core kv-cache blocks initialization logic (#36521) · 65b2f405
  Nick Hill authored Mar 10, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  65b2f405
- [BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219) · 4ff8c3c8
  Vadim Gimpelson authored Mar 10, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4ff8c3c8
07 Mar, 2026 2 commits
- [UX][Startup] Account for CUDA graphs during memory profiling (#30515) · ebb9cc5f
  Matthew Bonanni authored Mar 07, 2026
  
  ebb9cc5f
- [Model Runner V2] Fix warmup for pipeline parallel (#36280) · b3546865
  Nick Hill authored Mar 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  b3546865
06 Mar, 2026 1 commit

[Feature] Add --distributed-timeout-seconds CLI option (#36047) · 03a49bb8

Shiyan Deng authored Mar 05, 2026


Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

03a49bb8

05 Mar, 2026 1 commit
- [Model Runner V2] Fix warmup for very small kvcache and/or blocksizes (#36176) · a73af584
  Nick Hill authored Mar 05, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a73af584
04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit
- [Core] Move save_tensorized_model logic to Worker (#35825) · d15c3b90
  Nick Hill authored Mar 03, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  d15c3b90
02 Mar, 2026 1 commit

[MyPy][BugFix] Check profiler is assigned before calling start() on it (#35505) · 87c98b02

Martin Hickey authored Mar 02, 2026


Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

87c98b02

28 Feb, 2026 3 commits

[Bugfix] Propagate compilation_time from workers to main process for TP>1 (#35503) · 7b346ba8
Huy Do authored Feb 27, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
7b346ba8

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

[Model Runner V2] Support pooling models (#35120) · 86ac7bcf
Woosuk Kwon authored Feb 27, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
86ac7bcf

27 Feb, 2026 2 commits
- [Model Runner V2] Warmup kernels (#35172) · b1d9f537
  Nick Hill authored Feb 27, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  b1d9f537
- [Core] Fix `gpu_worker.py` pre-commit errors (#35312) · 876312f0
  Nick Hill authored Feb 27, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  876312f0
13 Feb, 2026 2 commits

[Feature] Pipeline Parallel Async send/recv, 2.9% E2E throughput improvement (#33368) · 3d2a026f

Wentao Ye authored Feb 13, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

3d2a026f

[Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

4453ba8d

11 Feb, 2026 1 commit

[MoE Refactor] Introduce MoERunner abstraction and move execution logic from... · d1481ba7

bnellnm authored Feb 10, 2026


[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)
Signed-off-by: Bill Nell <bnell@redhat.com>

d1481ba7

10 Feb, 2026 2 commits
- [BugFix] Fix async EPLB hang with DeepEP LL all2all backend (#32860) · bb2fc8b5
  Ilya Markov authored Feb 10, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  bb2fc8b5
- [Bugfix] Fix weights offloading for sleep mode (#32947) · 506ad7d7
  J Seppänen authored Feb 10, 2026
```
Signed-off-by: Jarno Seppänen <jseppanen@nvidia.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  506ad7d7
06 Feb, 2026 2 commits
- [Log] Optimize duplicate startup log (#33944) · 67a746e8
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  67a746e8
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
05 Feb, 2026 1 commit

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

04 Feb, 2026 1 commit
- [rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308) · 2f6d17cb
  kourosh hakhamaneshi authored Feb 04, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  2f6d17cb
31 Jan, 2026 1 commit
- Support clear mm and encoder cache (#33452) · 22d9a056
  jma99_2333 authored Jan 31, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  22d9a056
30 Jan, 2026 1 commit
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
29 Jan, 2026 1 commit
- [BUGFIX][XPU] fix memory check after XPU reuse GPU_worker (#33358) · 8c8ebeb9
  Chendi.Xue authored Jan 29, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  8c8ebeb9
28 Jan, 2026 1 commit
- [ModelRunner V2] Misc code simplification and cleanup (#33266) · 6bf3b46d
  Nick Hill authored Jan 28, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  6bf3b46d
24 Jan, 2026 1 commit

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

23 Jan, 2026 1 commit
- [Model Runner V2] Add KV Connector support (#32742) · 8518b304
  Nick Hill authored Jan 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  8518b304
19 Jan, 2026 1 commit
- [Model Runner V2] Refactor `dummy_run` (#32533) · 43fada53
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  43fada53