Commits · 1b19bd758936496751432eccabf8adb7b5d8936a · OpenDAS / vllm_cscc

10 Apr, 2026 1 commit
- [Model][Perf] Enable checkpoints prefetching for Lustre FS by default (#39422) · bb6047db
  Artem Perevedentsev authored Apr 10, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  bb6047db
03 Apr, 2026 2 commits
- [Frontend] new online quantization frontend (#38138) · 7b1a7423
  Vasiliy Kuznetsov authored Apr 03, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  7b1a7423
- [Bug] Add e_score_correction_bias to SKIP_TENSORS (#38746) · 4729b908
  Aaron Hao authored Apr 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  4729b908
31 Mar, 2026 2 commits
- [Quantization] Consolidate dummy format logic into DummyModelLoader (#38637) · 3dc01ef3
  Asaf Gardin authored Apr 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  3dc01ef3
- [Online Quant] [QeRL] Minor code cleanup (#38574) · 5869f69c
  Kyle Sayers authored Mar 31, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  5869f69c
30 Mar, 2026 2 commits
- [Bug fix][Quantization] Fix dummy weight loading (#38478) · 1fc69f59
  Asaf Gardin authored Mar 30, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  1fc69f59
- [Model][Quantization] Add GGUF support for MiniMax-M2.1 (#36965) · 63babd17
  PikaPikachu authored Mar 30, 2026
```
Signed-off-by: kangletian <Letian.Kang@amd.com>
```
  63babd17
29 Mar, 2026 1 commit
- [QeRL] Fix online quantized reloading (#38442) · d28d86e8
  Kyle Sayers authored Mar 29, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d28d86e8
28 Mar, 2026 1 commit

[CI]revert initialize_model context manager (#38426) · aa4eb0db

Kunshang Ji authored Mar 29, 2026


Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

aa4eb0db

27 Mar, 2026 1 commit
- [QeRL] Compose online quantization with quantized reloading (#38032) · 648edcf7
  Kyle Sayers authored Mar 27, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  648edcf7
26 Mar, 2026 1 commit
- [ROCm][CI] Fix flaky GPTQ compile correctness test (#38161) · f2d16207
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f2d16207
25 Mar, 2026 1 commit
- [Performance] Auto-enable prefetch on NFS with RAM guard (#37673) · a93a53f8
  Artem Perevedentsev authored Mar 25, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  a93a53f8
24 Mar, 2026 1 commit
- [Mypy] Fix mypy for `vllm/model_executor` (except `vllm/model_executor/layers`) (#37904) · b3601da6
  Harry Mellor authored Mar 24, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b3601da6
19 Mar, 2026 1 commit
- [BUG] Exclude SKIP_TENSORS from get_layer_size() + new weight sync example for dpep (#37334) · 5f82706a
  Aaron Hao authored Mar 18, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  5f82706a
18 Mar, 2026 2 commits

[Bugfix] Fix EP weight filter breaking EPLB and NVFP4 accuracy (#37322) · 17c47fb8

Elvir Crnčević authored Mar 18, 2026


Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>

17c47fb8

[Performance] Add --enable-ep-weight-filter CLI option (#37351) · 761e0aa7

Roy Wang authored Mar 18, 2026


Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

761e0aa7

16 Mar, 2026 3 commits
- [Performance] Add prefetch for checkpoints to OS page cache (#36012) · f5e59ee7
  Artem Perevedentsev authored Mar 16, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  f5e59ee7
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
- [Performance][Model Loader] Skip non-local expert weights during EP model loading (#37136) · 821eb80c
  Roy Wang authored Mar 16, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  821eb80c
15 Mar, 2026 1 commit
- [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) · a3e2e250
  Hari authored Mar 15, 2026
```
Signed-off-by: hasethuraman <hsethuraman@microsoft.com>
```
  a3e2e250
14 Mar, 2026 2 commits
- [Feature] Add InstantTensor weight loader (#36139) · 8c29042b
  arlo authored Mar 15, 2026
  
  8c29042b
- [Misc] Clean up Kimi-audio whisper encoder loading (#36903) · a8e8d62d
  Isotr0py authored Mar 14, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a8e8d62d
12 Mar, 2026 1 commit
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
09 Mar, 2026 1 commit
- fix: Use iterator as not to store all the file loads in memory at once (#36149) · 90512b2e
  Shaun Kotek authored Mar 09, 2026
```
Signed-off-by: Shaun Kotek - Nvidia <skotek@nvidia.com>
```
  90512b2e
04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

26 Feb, 2026 1 commit
- add mixed precision support for modelopt (#35047) · d0105b84
  sychen52 authored Feb 26, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  d0105b84
25 Feb, 2026 2 commits
- Revert "[Misc] Enable weights loading tracking for quantized models" (#35309) · 15d76f74
  Lucas Wilkinson authored Feb 25, 2026
  
  15d76f74
- [Misc] Enable weights loading tracking for quantized models (#35074) · 4572a06a
  Isotr0py authored Feb 25, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4572a06a
23 Feb, 2026 1 commit
- Use Xet high performance mode for Transformers v5 (#35098) · c4f38696
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4f38696
18 Feb, 2026 1 commit
- [Quantization] - Added uses_meta_device_weights to quant config (#34645) · 1faa8cb7
  Asaf Joseph Gardin authored Feb 18, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  1faa8cb7
13 Feb, 2026 1 commit

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to... · 59d53066

Wei Zhao authored Feb 13, 2026


[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

59d53066

12 Feb, 2026 2 commits
- [Bugfix] Remove broken raw url GGUF model loading support (#34433) · becbe248
  Isotr0py authored Feb 13, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  becbe248
- [Bugfix] Fix Sparse24 Compressed Tensors models (#33446) · e9cd6911
  Kyle Sayers authored Feb 12, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e9cd6911
10 Feb, 2026 2 commits
- [Misc][Spec Decode] support different load config for draft model (#34022) · 6f2f59f2
  Zhengkai Zhang authored Feb 10, 2026
```
Signed-off-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com>
Co-authored-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com>
```
  6f2f59f2
- [Bugfix] Sort hf_weights_files in fastsafetensors_weights_iterator to match #33491 (#34190) · 8d48d0a9
  Balaxxe authored Feb 10, 2026
```
Signed-off-by: Balaxxe <136368465+jaim12005@users.noreply.github.com>
```
  8d48d0a9
09 Feb, 2026 1 commit
- [BugFix] Fix `fastsafetensors` TP all procs using all GPUs (#34070) · d9bede03
  Nick Hill authored Feb 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d9bede03
06 Feb, 2026 1 commit
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
05 Feb, 2026 2 commits

[Minor] Sort safetensors files to ensure deterministic loading order (#33491) · 42d5d705

Lumosis authored Feb 05, 2026


Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

42d5d705

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

02 Feb, 2026 1 commit
- fix memory for online fp8 quantization with streaming weight load (#31914) · 0130223b
  Vasiliy Kuznetsov authored Feb 02, 2026
```
Signed-off-by: vasiliy <vasiliy@fb.com>
```
  0130223b