Commits · f20c3b095109fd2a016e201d550bcaae6414e9fc · OpenDAS / vllm_cscc

17 Sep, 2025 2 commits
- [BUG] Exclude .pth files when pulling remote files (#25092) · f20c3b09
  ahao-anyscale authored Sep 17, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  f20c3b09
- [UX] Remove "quantization is not fully optimized yet" log (#25012) · 67532a1a
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67532a1a
16 Sep, 2025 3 commits

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

Move `SpeculativeConfig` from `config/__init__.py` to `config/speculative.py` (#24904) · 0faf3cc3
Harry Mellor authored Sep 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
0faf3cc3
Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b

15 Sep, 2025 1 commit

Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` (#24659) · c4afdb69

Harry Mellor authored Sep 15, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c4afdb69

12 Sep, 2025 2 commits
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
- [CI] Add ci_envs for convenient local testing (#24630) · d21a36f5
  wang.yuqi authored Sep 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d21a36f5
11 Sep, 2025 7 commits
- [Doc] Clarify cudagraph capture size logic and default behavior in scheduler (#18698) · 7a30fa87
  Zazzle516 authored Sep 12, 2025
```
Signed-off-by: Zazzle516 <2405677060@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7a30fa87
- [HybridKVCache][Platform] Add support_hybrid_kv_cache for platform (#24646) · 4f6593b0
  Mengqing Cao authored Sep 11, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  4f6593b0
- Move `LoRAConfig` from `config/__init__.py` to `config/lora.py` (#24644) · 5f5271f1
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f5271f1
- [CI Failure] fix models/language/pooling/test_auto_prefix_cache_support.py (#24636) · 25bb9e8c
  wang.yuqi authored Sep 11, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  25bb9e8c
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9
- [Doc]: fixing doc typos (#24635) · e2b1f863
  Didier Durand authored Sep 11, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  e2b1f863
- [Ultravox] Fix Gemma instantiation, support quantization via --hf-overrides (#24131) · f17a6aa4
  Peter Salas authored Sep 10, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  f17a6aa4
10 Sep, 2025 7 commits

[v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
37e8182b

[Core] Support configuration parsing plugin (#24277) · 9fb74c27

Xingyu Liu authored Sep 10, 2025

Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9fb74c27

Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f36355ab
Support for NemotronH Nano VLM (#23644) · 72d30108
danielafrimi authored Sep 10, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
72d30108
[Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348) · feaf202e
Remy authored Sep 10, 2025
```
Signed-off-by: Remy <eunhwan.shin@dtonic.io>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
feaf202e

[Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae

pwschuurman authored Sep 09, 2025


Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4377b1ae

[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable... · 53b42f41

Wenlong Wang authored Sep 09, 2025


[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable test for LlamaForCausalLMEagle3 (#24392)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>

53b42f41

09 Sep, 2025 3 commits
- [Model] Systematic support for fp32 head, pooling models part (#23810) · 19332c04
  wang.yuqi authored Sep 09, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  19332c04
- Add data_parallel_size to VllmConfig string representation (#24298) · b2f77457
  cong-meta authored Sep 08, 2025
```
Co-authored-by: Cong Chen <congc@meta.com>
```
  b2f77457
- Move `KVTransferConfig` from `config/__init__.py` to `config/kv_transfer.py` (#24434) · 3e0d4a34
  Harry Mellor authored Sep 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3e0d4a34
08 Sep, 2025 2 commits
- Move `KVEventsConfig` from `config/__init__.py` to `config/kv_events.py` (#24433) · 03dd652c
  Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  03dd652c
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
06 Sep, 2025 4 commits
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
- Lora bias(enable_lora_bias) deprecate warning (#24339) · 6024d115
  Ashwin Phadke authored Sep 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6024d115
- [New Model]: google/embeddinggemma-300m (#24318) · 6d6c6b05
  wang.yuqi authored Sep 06, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6d6c6b05
- [KV Sharing] Raise error if using eagle with fast prefill (#24350) · 3c529fc9
  Yong Hoon Shin authored Sep 05, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  3c529fc9
04 Sep, 2025 2 commits

Use hidden_size_per_head as head_size fallback (#24221) · 2b30afa4
nopperl authored Sep 04, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
2b30afa4

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

03 Sep, 2025 2 commits
- Remove deprecated `PyNcclConnector` (#24151) · b5ee1e32
  Peter Pan authored Sep 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  b5ee1e32
- [Misc] Add check for dual_chunk_attention (#24070) · e81d4e69
  Jiangyun Zhu authored Sep 03, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  e81d4e69
02 Sep, 2025 1 commit

[Model] Classification models support logit_bias / sigmoid_normalize (#24031) · e0653f6c

wang.yuqi authored Sep 03, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e0653f6c

01 Sep, 2025 2 commits

[Frontend] Update the warning log when using VLLM_ALLOW_LONG_MAX_MODEL_LEN (#20904) · 55602bb2

wang.yuqi authored Sep 01, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

55602bb2

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

28 Aug, 2025 1 commit
- Add deprecation warning for lora_extra_vocab_size (#23635) · c8851a47
  Jinheng authored Aug 28, 2025
```
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
```
  c8851a47
27 Aug, 2025 1 commit
- [Model] Merge `SupportsMultiModalWithRawInput` with `SupportsMultiModal` (#23749) · 52883ed0
  Cyrus Leung authored Aug 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  52883ed0