Commits · 3125d7995020f4ae1b7777e41af6c3a6e714cb1c · OpenDAS / vllm_cscc

16 Oct, 2025 1 commit
- [BUG] Allow runai_streamer_sharded in config check (#26958) · 582f2c6b
  ahao-anyscale authored Oct 15, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  582f2c6b
15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 2 commits

[Feature] Change vllm.py with pydantic validation (#26726) · c715ba37

Vladislav Bronzov authored Oct 14, 2025

Signed-off-by: Vladislav <vladislav.bronzov@gmail.com>
Signed-off-by: Vladislav Bronzov <58587565+VladOS95-cyber@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

c715ba37

[UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
3e051bda

13 Oct, 2025 1 commit

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

12 Oct, 2025 3 commits
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [Bugfix][DCP] Set default CUDAGraphMode to PIECEWISE for DCP (#26574) · b91d8db8
  Jaya Yuan authored Oct 12, 2025
```
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
```
  b91d8db8
- [MISC] Rename the torch profiler filename as instance_id+rank_id for merging... · 76852017
  wang.yuqi authored Oct 12, 2025
```
[MISC] Rename the torch profiler filename as instance_id+rank_id for merging the Profiler results of each Rank (#25867)
Signed-off-by: wang.yuqi <noooop@126.com>
```
  76852017
09 Oct, 2025 1 commit

Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate... · 5728da11

Jiangyun Zhu authored Oct 09, 2025


Revert  #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>

5728da11

08 Oct, 2025 1 commit

[BugFix] Fix failing test... · e1ba2356

Morrison Turnansky authored Oct 08, 2025


[BugFix] Fix failing test quantization/test_compressed_tensors.py::test_compressed_tensors_fp8_block_enabled (#26436)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>

e1ba2356

07 Oct, 2025 1 commit

[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in... · 0c824fc4

Morrison Turnansky authored Oct 07, 2025


[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

0c824fc4

06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [CI Failure] fix_test_auto_prefix_cache_support (#26053) · 7d6b0338
  Huamin Li authored Oct 04, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  7d6b0338
02 Oct, 2025 1 commit

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) · 502640c3

ElizaWszola authored Oct 02, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

502640c3

01 Oct, 2025 1 commit
- [MISC] Fix misleading batch_size_capture_list when cuda_graph_sizes < 4 (#25829) · 2518230d
  billishyahao authored Oct 01, 2025
```
Signed-off-by: billishyahao <bill.he@amd.com>
Co-authored-by: Luka Govedic <ProExpertProg@users.noreply.github.com>
```
  2518230d
30 Sep, 2025 2 commits
- [Bugfix]: Clean up chunked prefill logging when using whisper (#25075) · e23cacda
  Simon Danielsson authored Sep 30, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  e23cacda
- Move`VllmConfig` from `config/__init__.py` to `config/vllm.py` (#25271) · 61aedb5f
  Harry Mellor authored Sep 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61aedb5f
27 Sep, 2025 1 commit

[torch.compile]: Add VLLM_DEBUG_DUMP_PATH environment variable (#25651) · c0ec8183

Jiangyun Zhu authored Sep 28, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

c0ec8183

26 Sep, 2025 3 commits
- [V1] address post issues related to #20059 (part 1) (#23046) · f075693d
  fhl2000 authored Sep 27, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  f075693d
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
- [Core] Force PIECEWISE CUDAGraph mode for encoder-decoder (#25701) · 13dd93c6
  Russell Bryant authored Sep 25, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  13dd93c6
25 Sep, 2025 2 commits
- [V0 deprecation] Clean up V0 fallback in compilation config (#25675) · 71b25b0d
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  71b25b0d
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
24 Sep, 2025 1 commit
- Move `DeviceConfig`, `ObservabilityConfig`, `SpeechToTextConfig` to their own files (#25564) · 8938774c
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8938774c
23 Sep, 2025 3 commits

[Perf] Change default CUDAGraphMode from PIECEWISE to FULL_AND_PIECEWISE (#25444) · 24fab45d
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
24fab45d

[Performance] Move apply_w8a8_block_fp8_linear to an op class (#24666) · 63400259

ElizaWszola authored Sep 23, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

63400259

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845) · cc1dc7ed

Lucas Wilkinson authored Sep 23, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

cc1dc7ed

22 Sep, 2025 2 commits

[torch.compile] Cleanup compilation tests and custom passes, add debug utils,... · d5e0fca2

Luka Govedič authored Sep 22, 2025


[torch.compile] Cleanup compilation tests and custom passes, add debug utils, fix DCE bug (#23091), fix test (#24376), and prep for custom op matching (#24604) (#24542)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d5e0fca2

refactor: abstract graph mode support into platform interface (#25161) · b6f01bd9
Yizhou authored Sep 22, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
b6f01bd9

21 Sep, 2025 1 commit
- [V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334) · 0ff8ebb2
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0ff8ebb2
19 Sep, 2025 2 commits
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
- Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  058525b9
18 Sep, 2025 4 commits
- Fix `validate-config` pre-commit check (#25157) · 3ed1ec4a
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3ed1ec4a
- Move `StructuredOutputsConfig` from `config/__init__.py` to `config/structured_outputs.py` (#25153) · 8ed039d5
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8ed039d5
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- [Bugfix] when use s3 model cannot use default load_format (#24435) · 350c94de
  rongfu.leng authored Sep 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  350c94de
17 Sep, 2025 2 commits
- [BUG] Exclude .pth files when pulling remote files (#25092) · f20c3b09
  ahao-anyscale authored Sep 17, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  f20c3b09
- [UX] Remove "quantization is not fully optimized yet" log (#25012) · 67532a1a
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67532a1a
16 Sep, 2025 1 commit

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995