Commits · 8f87eb4622cf7516ce34c1f9703fee43fb0101e1 · OpenDAS / vllm_cscc

22 Apr, 2026 1 commit

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

21 Apr, 2026 2 commits
- [Startup][UX] Enable CUDAGraph memory profiling by default (#38284) · 96a85c57
  Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  96a85c57
- [UX] Bump version in CG memory profiling log message (#40465) · ab5666eb
  Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  ab5666eb
20 Apr, 2026 1 commit
- [XPU] [torch.compile] Skipping CUDA graph memory estimation to avoid startup errors. (#39977) · 4f4713f9
  Chaojun Zhang authored Apr 20, 2026
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  4f4713f9
14 Apr, 2026 1 commit
- Measure encoder compile time seperate from llm backbone (#39240) · c08f3b2a
  Lucas Kabela authored Apr 14, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  c08f3b2a
01 Apr, 2026 1 commit
- [1/N][Cleanup] Standardize on use of `is_quantized_kv_cache` (#38659) · 116f4be4
  Matthew Bonanni authored Apr 01, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  116f4be4
31 Mar, 2026 1 commit
- [torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
  BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  077a9a8e
20 Mar, 2026 2 commits

elastic_ep: Fix issues with repeated scale up/down cycles (#37131) · c57d38d6
Itay Alroy authored Mar 21, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
c57d38d6

fix CUDAGraph memory being counted twice (#37426) · 79eb9369

Peter Pan authored Mar 21, 2026


Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

79eb9369

17 Mar, 2026 2 commits
- [Bugfix][ROCm] Fix worker startup OOM on ROCm by skipping unreliable cudagraph... · e8f9dbc3
  JartX authored Mar 17, 2026
```
[Bugfix][ROCm] Fix worker startup OOM on ROCm by skipping unreliable cudagraph memory profiling (#36720)
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  e8f9dbc3
- [Bugfix] Fix DP MTP Dummy Run (#35243) · f63ed7b5
  Benjamin Chislett authored Mar 17, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  f63ed7b5
16 Mar, 2026 1 commit
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
12 Mar, 2026 1 commit
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
11 Mar, 2026 3 commits
- [BUG] Fix async rlhf tests (#35811) · d6b61e51
  Aaron Hao authored Mar 11, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  d6b61e51
- Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf
  Hongxin Xu authored Mar 11, 2026
```
Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  bea02cdf
- [Doc] Fix duplicate words in comments (#36713) · 4bf53362
  Hongbin Guo authored Mar 11, 2026
```
Signed-off-by: Hongbin10 <jdmjdm1998@163.com>
```
  4bf53362
10 Mar, 2026 2 commits
- [Core] Simplify core kv-cache blocks initialization logic (#36521) · 65b2f405
  Nick Hill authored Mar 10, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  65b2f405
- [BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219) · 4ff8c3c8
  Vadim Gimpelson authored Mar 10, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4ff8c3c8
07 Mar, 2026 2 commits
- [UX][Startup] Account for CUDA graphs during memory profiling (#30515) · ebb9cc5f
  Matthew Bonanni authored Mar 07, 2026
  
  ebb9cc5f
- [Model Runner V2] Fix warmup for pipeline parallel (#36280) · b3546865
  Nick Hill authored Mar 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  b3546865
06 Mar, 2026 1 commit

[Feature] Add --distributed-timeout-seconds CLI option (#36047) · 03a49bb8

Shiyan Deng authored Mar 05, 2026


Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

03a49bb8

05 Mar, 2026 1 commit
- [Model Runner V2] Fix warmup for very small kvcache and/or blocksizes (#36176) · a73af584
  Nick Hill authored Mar 05, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a73af584
04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit
- [Core] Move save_tensorized_model logic to Worker (#35825) · d15c3b90
  Nick Hill authored Mar 03, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  d15c3b90
02 Mar, 2026 1 commit

[MyPy][BugFix] Check profiler is assigned before calling start() on it (#35505) · 87c98b02

Martin Hickey authored Mar 02, 2026


Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

87c98b02

28 Feb, 2026 3 commits

[Bugfix] Propagate compilation_time from workers to main process for TP>1 (#35503) · 7b346ba8
Huy Do authored Feb 27, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
7b346ba8

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

[Model Runner V2] Support pooling models (#35120) · 86ac7bcf
Woosuk Kwon authored Feb 27, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
86ac7bcf

27 Feb, 2026 2 commits
- [Model Runner V2] Warmup kernels (#35172) · b1d9f537
  Nick Hill authored Feb 27, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  b1d9f537
- [Core] Fix `gpu_worker.py` pre-commit errors (#35312) · 876312f0
  Nick Hill authored Feb 27, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  876312f0
13 Feb, 2026 2 commits

[Feature] Pipeline Parallel Async send/recv, 2.9% E2E throughput improvement (#33368) · 3d2a026f

Wentao Ye authored Feb 13, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

3d2a026f

[Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

4453ba8d

11 Feb, 2026 1 commit

[MoE Refactor] Introduce MoERunner abstraction and move execution logic from... · d1481ba7

bnellnm authored Feb 10, 2026


[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)
Signed-off-by: Bill Nell <bnell@redhat.com>

d1481ba7

10 Feb, 2026 2 commits
- [BugFix] Fix async EPLB hang with DeepEP LL all2all backend (#32860) · bb2fc8b5
  Ilya Markov authored Feb 10, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  bb2fc8b5
- [Bugfix] Fix weights offloading for sleep mode (#32947) · 506ad7d7
  J Seppänen authored Feb 10, 2026
```
Signed-off-by: Jarno Seppänen <jseppanen@nvidia.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  506ad7d7
06 Feb, 2026 2 commits
- [Log] Optimize duplicate startup log (#33944) · 67a746e8
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  67a746e8
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
05 Feb, 2026 1 commit

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

04 Feb, 2026 1 commit
- [rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308) · 2f6d17cb
  kourosh hakhamaneshi authored Feb 04, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  2f6d17cb
31 Jan, 2026 1 commit
- Support clear mm and encoder cache (#33452) · 22d9a056
  jma99_2333 authored Jan 31, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  22d9a056