Commits · 3ada34f9cb4d1af763fdfa3b481862a93eb6bd2b · OpenDAS / vllm_cscc

21 Oct, 2025 2 commits
- [Frontend] Enforce tokenize=False when applying chat template (#27205) · 3ada34f9
  Russell Bryant authored Oct 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3ada34f9
- create is_in_the_same_node on cpu (#26832) · 0eb8f2b8
  Lunwen He authored Oct 20, 2025
```
Co-authored-by: Lunwen He <lunwenh@meta.com>
```
  0eb8f2b8
20 Oct, 2025 3 commits

[Bugfix][CI] Fix `Distributed Tests (4 GPUs)` async_sched+ray test (#27195) · f9e7ad54
Nicolò Lucchesi authored Oct 20, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
f9e7ad54

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143

[Model][VLM] Support Bee-8B Model (#27012) · f32bf758

Yi Zhang authored Oct 20, 2025


Signed-off-by: uyzhang <yi.zhang.4096@gmail.com>
Signed-off-by: Yi Zhang <zhangyi970819@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

f32bf758

19 Oct, 2025 3 commits
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
- [Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f
  iAmir97 authored Oct 19, 2025
```
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
```
  7a6c8c3f
- [Chore] Separate out hashing utilities from vllm.utils (#27151) · 8a297115
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  8a297115
18 Oct, 2025 7 commits

[V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
83e760c5
[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f
[Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
245e4f2c

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

[Test] Add test for /health endpoint on engine failure (#26074) · 83004020
dongbo910220 authored Oct 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
83004020

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) · 7c572544

Hanchenli authored Oct 17, 2025


Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7c572544

[CI/Build] tests(v1): feed Triton attention the (num_blocks, 2, …) KV cache... · c3123207

Huamin Li authored Oct 17, 2025


[CI/Build] tests(v1): feed Triton attention the (num_blocks, 2, …) KV cache layout in backend-correctness tests (#26663)
Signed-off-by: Huamin Li <3ericli@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

c3123207

17 Oct, 2025 11 commits
- [Test] Make `test_failure` more stable for batch invariance (#27054) · f50cc221
  Wentao Ye authored Oct 17, 2025
  
  f50cc221
- [Chore] Remove unused `PolyNorm` layer (#27110) · 3125d799
  Isotr0py authored Oct 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3125d799
- [CI] Nixl integration tests (#27010) · 2ba60ec7
  Nicolò Lucchesi authored Oct 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2ba60ec7
- [torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604) · bd7157a0
  Luka Govedič authored Oct 17, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bd7157a0
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- [Model] Add support for LightOnOCR (#26916) · 3aeb19a3
  Said Taghadouini authored Oct 17, 2025
```
Signed-off-by: Said Taghadouini <taghadouinisaid@gmail.com>
Signed-off-by: Said Taghadouini <84044788+staghado@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  3aeb19a3
- [Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c017b34
- [Kernel] Lazy import FlashInfer (#26977) · fec2b341
  Jee Jee Li authored Oct 17, 2025
  
  fec2b341
- [torch.compile] fix simple inductor graph partition test (#27050) · 17c540a9
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  17c540a9
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
- [torch.compile] Passing only necessary compilation config to inductor pass config (#27041) · 11ae016b
  Lucia Fang authored Oct 16, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  11ae016b
16 Oct, 2025 14 commits
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
- Refactor Transformers backend to use mixins (#26906) · fb5e10d3
  Harry Mellor authored Oct 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb5e10d3
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [CI] Prune Quantization Tests and skip compilation (#27038) · 01c977e9
  Michael Goin authored Oct 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  01c977e9
- [Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to... · b3dda72c
  Wentao Ye authored Oct 16, 2025
```
[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to `get_mk_alignment_for_contiguous_layout` (#26935)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b3dda72c
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0
- [Bug] Fix batch invariant test `has` to `is` (#27032) · 2ed8b6b3
  Wentao Ye authored Oct 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2ed8b6b3
- Support `set` in the CLI generation (#27031) · aa255ff5
  Harry Mellor authored Oct 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aa255ff5
- [CI] Replace large models with tiny alternatives in tests (#24057) · 43721bc6
  Tahsin Tunan authored Oct 16, 2025
```
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  43721bc6
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [CI/Build] Update expected beam search output for Phi3V (#26978) · 76f0d05b
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  76f0d05b
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
- [BugFix] Work around graph partition x torch.compile cache issue (#26956) · 9b6504c3
  Richard Zou authored Oct 15, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  9b6504c3