Commits · 85fee74b337522f7e0807fc100b9e00682ff45e1 · OpenDAS / vllm_cscc

24 Oct, 2025 1 commit
- [Bugfix][CI] Move resolving cudagraph_mode before initializing attn_metadata_builder (#27427) · 85fee74b
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  85fee74b
23 Oct, 2025 3 commits

[Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
ca76486a

[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow... · 237cf6d3

Ilya Markov authored Oct 23, 2025


[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709)
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

237cf6d3

[V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
6644796b

22 Oct, 2025 2 commits

[Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
a0003b56

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

21 Oct, 2025 2 commits
- [Bugfix] skip cuda graph for drafter when running with eager (#26821) · 19748806
  Benjamin Chislett authored Oct 21, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  19748806
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
20 Oct, 2025 2 commits

Nemotron Nano V2 VL + EVS Video Support (#27107) · e93ff6c8

Eugene Khvedchenya authored Oct 20, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Natan Bagrov <nbagrov@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e93ff6c8

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143

19 Oct, 2025 2 commits
- [Bugfix] Fix error with penalties when speculative decoding and structural... · f6fdacd8
  Sergei Skvortsov authored Oct 19, 2025
```
[Bugfix] Fix error with penalties when speculative decoding and structural output are enabled (#26586)
Signed-off-by: southfreebird <yvorott@gmail.com>
```
  f6fdacd8
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
18 Oct, 2025 3 commits

[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f
[Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
b26b70be

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

17 Oct, 2025 4 commits
- [V1][Spec Decode] Fix greedy temperature detection after sampler refactor (#27077) · acedc74b
  Pradyun92 authored Oct 17, 2025
```
Signed-off-by: Pradyun Ramadorai <pradyunr@amazon.com>
Co-authored-by: Pradyun Ramadorai <pradyunr@amazon.com>
```
  acedc74b
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- Remove unused imports (#26972) · 4d055ef4
  Lukas Geiger authored Oct 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4d055ef4
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
16 Oct, 2025 3 commits
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
- [bugfix] Fix SP + PP without specifying compile size (#26955) · e19b16dd
  Angela Yi authored Oct 15, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  e19b16dd
15 Oct, 2025 2 commits

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
f54f8512

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 5 commits
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
- [Minor] Group async_scheduling related fields in model runner init (#26736) · ff4810ba
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ff4810ba
- [Config] Remove Unused Environment Variable `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` (#26743) · 6d87a283
  Wentao Ye authored Oct 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6d87a283
- [DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d
  Jaya Yuan authored Oct 14, 2025
```
Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>
```
  ea97940d
- Fix lora tests failure in TPU CI due to the removal of LoRA bias (#26723) · 4497c8f8
  XiongfeiWei authored Oct 13, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  4497c8f8
13 Oct, 2025 2 commits
- [Log] Optimize Startup Log (#26601) · e251e457
  Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e251e457
- [FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
  yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
  46ad7395
12 Oct, 2025 2 commits
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [MISC] Rename the torch profiler filename as instance_id+rank_id for merging... · 76852017
  wang.yuqi authored Oct 12, 2025
```
[MISC] Rename the torch profiler filename as instance_id+rank_id for merging the Profiler results of each Rank (#25867)
Signed-off-by: wang.yuqi <noooop@126.com>
```
  76852017
11 Oct, 2025 2 commits

[Refactor]: Use M-RoPE interface directly while defining model class instead... · 727144be

dsinghvi authored Oct 11, 2025


[Refactor]: Use M-RoPE interface directly while defining model class instead of maintaining model specific M-RoPE implementation in mrope.py (#24172)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: wwl2755 <wangwenlong2755@gmail.com>

727144be

[MM] Move Qwen3Omni MRoPE impl to model file (#26608) · ddaff293

Roger Wang authored Oct 10, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddaff293

10 Oct, 2025 5 commits
- [BugFix] Make penalties and bad_words work with async scheduling (#26467) · 5bc26c43
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5bc26c43
- [BugFix] Fix async scheduling + request preemption (#26385) · 949cb017
  Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  949cb017
- [Bugfix] Make DP padding optional in coordinate_batch_across_dp (#26375) · ae9d0e7d
  Sage Moore authored Oct 10, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  ae9d0e7d
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
- [deepseek] kernel block size for UniformTypeKVCacheSpecs (#26559) · 6f0f570c
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6f0f570c