Commits · 59d53066d8daed5c2e39e3bce38ac308bc80a9ae · OpenDAS / vllm_cscc

13 Feb, 2026 1 commit

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to... · 59d53066

Wei Zhao authored Feb 13, 2026


[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

59d53066

10 Feb, 2026 3 commits
- [torch.compile] Disable recursive pre_grad_passes (#34092) · 341eed3d
  Richard Zou authored Feb 10, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  341eed3d
- [Feature] Warn about unrecognized environment variables (#33581) · f0ca0671
  Gregory Shtrasberg authored Feb 10, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  f0ca0671
- [compile] Enable AOT compile with 2.10 in trunk. (#34155) · 82e11973
  Zhengxu Chen authored Feb 10, 2026
```
Signed-off-by: Zhengxu Chen <zhxchen17@meta.com>
```
  82e11973
08 Feb, 2026 1 commit
- [Release 2.10] Update to Torch 2.10 - final release (#30525) · f97ca671
  Andrey Talman authored Feb 08, 2026
  
  f97ca671
04 Feb, 2026 1 commit
- [Deprecation] Deprecate profiling envs (#33722) · d88a1df6
  Wentao Ye authored Feb 04, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d88a1df6
03 Feb, 2026 2 commits
- [Misc] Remove deprecated VLLM_ALL2ALL_BACKEND environment variable (#33535) · b95cc501
  杨朱 · Kiki authored Feb 03, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  b95cc501
- [Misc] Remove deprecated profiler environment variables (#33536) · ef248ff7
  杨朱 · Kiki authored Feb 03, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  ef248ff7
30 Jan, 2026 1 commit
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
29 Jan, 2026 1 commit
- Make `mypy` opt-out instead of opt-in (#33205) · fb946a7f
  Harry Mellor authored Jan 29, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb946a7f
27 Jan, 2026 1 commit

[Models] Kimi-K2.5 (#33131) · b539f988

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b539f988

26 Jan, 2026 2 commits
- [fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
  dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  58a05b0c
- [Misc] HF Hub LoRA Resolver (#20320) · 9ac818a5
  Alex Brooks authored Jan 26, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9ac818a5
25 Jan, 2026 1 commit
- [BugFix] Add env variable to control PDL in LoRA (#32836) · 73b24346
  Jee Jee Li authored Jan 25, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  73b24346
23 Jan, 2026 3 commits
- [fix] add VLLM_OBJECT_STORAGE_SHM_BUFFER_NAME to compile factors (#32912) · 0118cdcc
  dolpm authored Jan 23, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  0118cdcc
- [Bugfix] Disable tma_aligned_scales in test_fusions_e2e (#32916) · 90c20079
  Xin Yang authored Jan 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  90c20079
- [Misc] Log vLLM logo when starting server (#32796) · 7fe25588
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  7fe25588
22 Jan, 2026 3 commits
- [Misc] Replace urllib's `urlparse` with urllib3's `parse_url` (#32746) · 8ebf271b
  Isotr0py authored Jan 22, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ebf271b
- [AMD][ROCm] MoRI EP: a high-performance all2all backend (#28664) · 49a12622
  Alex Sun authored Jan 22, 2026
```
Signed-off-by: Alex Sun <alex.s@amd.com>
```
  49a12622
- [Deprecation] Remove deprecated environment variables (#32812) · 6437ff1f
  Wentao Ye authored Jan 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6437ff1f
20 Jan, 2026 2 commits
- [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) · 7c5dedc2
  dolpm authored Jan 20, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  7c5dedc2
- [Core] Cleanup shm based object store on engine shutdown (#32429) · 8be263c3
  Walter Beller-Morales authored Jan 20, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  8be263c3
18 Jan, 2026 1 commit
- [Feature] Add FIPS 140-3 compliant hash algorithm option for multimodal hashing (#32386) · 3055232b
  Karan Bansal authored Jan 18, 2026
```
Signed-off-by: Karan Bansal <karanb192@gmail.com>
```
  3055232b
16 Jan, 2026 1 commit

[Feat] Support non-gated MoE with Marlin, NVFP4 CUTLASS, FP8, INT8, compressed-tensors (#32257) · c277fbdf

TomerBN-Nvidia authored Jan 16, 2026


Signed-off-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@ipp1-1429.ipp1a1.colossus.nvidia.com>

c277fbdf

15 Jan, 2026 2 commits

[ROCM] DSfp4 mla projection gemms weight dynamic quantization (#32238) · 8c11001b
Aleksandr Malyshev authored Jan 15, 2026
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
8c11001b

[ROCm][Perf] Enable shuffle kv cache layout and assembly paged attention... · 130d6c95

Pleaplusone authored Jan 15, 2026


[ROCm][Perf] Enable shuffle kv cache layout and assembly paged attention kernel for `AiterFlashAttentionBackend` (#29887)
Signed-off-by: ganyi <ygan@amd.com>

130d6c95

13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

11 Jan, 2026 1 commit
- [CPU][BugFix] Disable AOT Compile for CPU (#32037) · 9103ed16
  Fadi Arafeh authored Jan 11, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  9103ed16
09 Jan, 2026 3 commits
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [UX] Add vLLM model inspection view (#29450) · d5ec6c05
  Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d5ec6c05
- [ROCm][PD] add moriio kv connector. (#29304) · 4505849b
  inkcherry authored Jan 09, 2026
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  4505849b
07 Jan, 2026 1 commit

[Perf][Kernels] Enable FlashInfer DeepGEMM swapAB on SM90 (for W8A8 Linear Op) (#29213) · cc6dafae

Kate Cheng authored Jan 07, 2026


Signed-off-by: Kate Cheng <yunhsuanc@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Jhao-Ting Chen <jhaotingc@nvidia.com>

cc6dafae

05 Jan, 2026 1 commit
- [Bug] Revert torch warning fix (#31585) · af9a7ec2
  Wentao Ye authored Jan 05, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  af9a7ec2
19 Dec, 2025 1 commit
- Make engine core client handshake timeout configurable (#27444) · 1ab52135
  Seiji Eicher authored Dec 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  1ab52135
18 Dec, 2025 2 commits

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

[Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9

SungMinCho authored Dec 17, 2025


Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

a0b782f9

17 Dec, 2025 1 commit
- [compile] Ignore VLLM_FORCE_AOT_LOAD from cache factors (#30809) · 9db1db59
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  9db1db59
16 Dec, 2025 1 commit
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
12 Dec, 2025 1 commit
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
11 Dec, 2025 1 commit
- [Chore] Fix torch precision warning (#30428) · d6464f26
  Wentao Ye authored Dec 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d6464f26