Commits · 8fcaaf6a165e661f63fc51be906bc05b0767332f · OpenDAS / vllm_cscc

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 2 commits
- Fix some typing issues found by `mypy==1.18.2` (#26596) · 7c12763b
  Harry Mellor authored Oct 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7c12763b
- [Model] Add FlexOlmo model implementation (#24923) · 8d2b8c0f
  Shane A authored Oct 10, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
  8d2b8c0f
09 Oct, 2025 1 commit
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
08 Oct, 2025 1 commit

[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197) · f8607863

Wentao Ye authored Oct 08, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f8607863

07 Oct, 2025 2 commits
- [Model] Lfm2Moe (#26344) · 320feae6
  Paul Pak authored Oct 08, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  320feae6
- [Model] Use `merge_by_field_config` for MM models (Ovis family) (#26308) · 08d26a1b
  Isotr0py authored Oct 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  08d26a1b
06 Oct, 2025 1 commit
- Support llama3 eagle3 head with llama4 verifier (#25961) · 05f6846e
  Rahul Tuli authored Oct 06, 2025
```
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  05f6846e
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
03 Oct, 2025 2 commits
- [CI] Fix Pre-commit Mypy Error (#26181) · 767cbb01
  Wentao Ye authored Oct 03, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  767cbb01
- [Bugfix] Relax tokenizer regex for mixtral to include 'tokenizer.model' (#25964) · 78b8015a
  Bowen Bao authored Oct 03, 2025
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
  78b8015a
30 Sep, 2025 2 commits

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

[BugFix] Pass config_format via try_get_generation_config (#25912) · e47433b3
acisseJZhong authored Sep 29, 2025

e47433b3

26 Sep, 2025 1 commit
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
25 Sep, 2025 1 commit
- [Bugfix] Fix InternS1 video processing after Transformers v4.56 (#25644) · 03858e6d
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  03858e6d
24 Sep, 2025 3 commits
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
- [Bugfix] add cache model when from object storage get model (#24764) · 2dda3e35
  rongfu.leng authored Sep 25, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  2dda3e35
- [BUG] Allows for RunAI Streamer and Torch.compile cache to be used together (#24922) · c8bde933
  ahao-anyscale authored Sep 23, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  c8bde933
22 Sep, 2025 1 commit

[Model] Support Dots OCR (#24645) · 7b57a433

Roger Wang authored Sep 21, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: yinz-aizip <yinz@aizip.ai>

7b57a433

21 Sep, 2025 3 commits
- feat: Enable engine-level arguments with speculators models (#25250) · c438b295
  Rahul Tuli authored Sep 21, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  c438b295
- [V0 Deprecation] Remove V0 Sequence class & Sampler (#25332) · 26e673fe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  26e673fe
- [Bugfix] Typos in error message for missing model config file (#25339) · 9aea7373
  Simon Danielsson authored Sep 21, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  9aea7373
20 Sep, 2025 1 commit
- [Docs] Fix warnings in vllm/profiler and vllm/transformers_utils (#25220) · 367a480b
  Michael Yao authored Sep 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  367a480b
18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 2 commits
- Add RADIO Vision Encoder Support to vLLM (#24595) · 252ada55
  danielafrimi authored Sep 17, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: root <root@cw-dfw-h100-001-305-026.cm.cluster>
```
  252ada55
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
16 Sep, 2025 1 commit
- Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
  Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  759ef49b
14 Sep, 2025 1 commit
- [Misc] Improve `s3_utils` type hints with `BaseClient` (#24825) · fec347de
  Hyogeun Oh (오효근) authored Sep 14, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  fec347de
13 Sep, 2025 2 commits
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
- [Model] Add Olmo3 model implementation (#24534) · 89e08d6d
  Shane A authored Sep 12, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  89e08d6d
11 Sep, 2025 4 commits
- [Ultravox] Use wrapped_model_config to instantiate inner model (#24679) · 127ded0a
  Peter Salas authored Sep 11, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  127ded0a
- Move `LoRAConfig` from `config/__init__.py` to `config/lora.py` (#24644) · 5f5271f1
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f5271f1
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9
- [Ultravox] Fix Gemma instantiation, support quantization via --hf-overrides (#24131) · f17a6aa4
  Peter Salas authored Sep 10, 2025
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  f17a6aa4
10 Sep, 2025 4 commits

[v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
37e8182b

[Core] Support configuration parsing plugin (#24277) · 9fb74c27

Xingyu Liu authored Sep 10, 2025

Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9fb74c27

[Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae

pwschuurman authored Sep 09, 2025


Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4377b1ae

[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable... · 53b42f41

Wenlong Wang authored Sep 09, 2025


[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable test for LlamaForCausalLMEagle3 (#24392)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>

53b42f41