Commits · 7da296be04933cfc29031f5bd1ba7cd28f376faa · OpenDAS / vllm_cscc

01 Jul, 2025 1 commit
- [CLI] Improve CLI arg parsing for `-O`/`--compilation-config` (#20156) · 6d42ce83
  Luka Govedič authored Jun 30, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  6d42ce83
28 Jun, 2025 1 commit
- [Misc] Add type assertion of request_id for LLMEngine.add_request (#19700) · e53be6f0
  Chales Xu authored Jun 28, 2025
```
Signed-off-by: n2ptr <xuzhanchaomail@163.com>
```
  e53be6f0
26 Jun, 2025 1 commit
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
24 Jun, 2025 1 commit
- [Fix][V1] Remove --scheduling-policy oracle (#20010) · 981eeca4
  amit authored Jun 24, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
```
  981eeca4
22 Jun, 2025 1 commit
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606
20 Jun, 2025 1 commit
- [CPU][CI] Fallback sliding window to v0 and fix CPU pooling model tests (#19901) · 79f2f1c2
  Li, Jiang authored Jun 20, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  79f2f1c2
19 Jun, 2025 2 commits

[Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
ead21102

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

18 Jun, 2025 3 commits
- [v1] Support mamba2 (#19327) · a89209b7
  Chen Zhang authored Jun 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  a89209b7
- [Platform] Allow platform use V1 Engine by default (#19792) · 257ab954
  wangxiyuan authored Jun 18, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  257ab954
- [MISC] correct DeviceConfig device field static type analysis (#19699) · 6e9cc73f
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6e9cc73f
13 Jun, 2025 1 commit
- [CPU] Refine default config for the CPU backend (#19539) · 64587211
  Li, Jiang authored Jun 13, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  64587211
11 Jun, 2025 2 commits
- [AMD] [Quantization] Add override flag for attention dtype instead of using... · c7ea0b56
  rasmith authored Jun 11, 2025
```
[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger (#17331)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  c7ea0b56
- [Doc] Update V1 User Guide for Hardware and Models (#19474) · 68b4a261
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68b4a261
10 Jun, 2025 2 commits
- [ROCm][V1] Adding ROCm to the list of plaforms using V1 by default (#19440) · 5241ca50
  Gregory Shtrasberg authored Jun 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5241ca50
- Revert "[v1] Add fp32 support to v1 engine through flex attn" (#19404) · 5f1ac1e1
  Isotr0py authored Jun 10, 2025
  
  5f1ac1e1
09 Jun, 2025 3 commits
- [Bugfix][Core] Prevent token lengths exceeding `max_model_len` in V0 (#19348) · c1c7dbbe
  22quinn authored Jun 09, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  c1c7dbbe
- [v1] Add fp32 support to v1 engine through flex attn (#19319) · b8089195
  Isotr0py authored Jun 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b8089195
- [Deprecation] Remove `inputs` arg fallback in Engine classes (#18799) · e31ae3de
  Cyrus Leung authored Jun 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e31ae3de
07 Jun, 2025 1 commit
- Add FlexAttention to V1 (#16078) · cf02f9b2
  Driss Guessous authored Jun 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  cf02f9b2
06 Jun, 2025 2 commits
- [Core] Raise when non-multi-instance DP clients target a DP rank (#19227) · 7353492a
  jmswen authored Jun 06, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  7353492a
- [v1] Hybrid Memory Allocator (#17996) · f8a1a2d1
  Chen Zhang authored Jun 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f8a1a2d1
04 Jun, 2025 4 commits
- [Bugfix] fix v1 cpu worker fails on macOS (#19121) · ef3f98b5
  Kebe authored Jun 05, 2025
  
  ef3f98b5
- Allow AsyncLLMEngine.generate to target a specific DP rank (#19102) · c8dcc159
  jmswen authored Jun 04, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  c8dcc159
- [NVIDIA] Add Cutlass MLA backend (#17625) · 41aa5784
  Kaixi Hou authored Jun 04, 2025
  
  41aa5784
- [CPU] V1 support for the CPU backend (#16441) · 4555143e
  Li, Jiang authored Jun 04, 2025
  
  4555143e
03 Jun, 2025 4 commits
- Fix interaction between `Optional` and `Annotated` in CLI typing (#19093) · 6865fe00
  Harry Mellor authored Jun 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Yikun Jiang <yikun@apache.org>
```
  6865fe00
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [bugfix] small fix logic issue (#18999) · 17430e36
  Reid authored Jun 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  17430e36
- [V1] Support DP with Ray (#18779) · bdce64f2
  Rui Qiao authored Jun 02, 2025
  
  bdce64f2
02 Jun, 2025 1 commit

[Model] enable data parallel for Llama4 vision encoder (#18368) · ebb1ec93

jennyyyyzhen authored Jun 02, 2025


Signed-off-by: yzhen <yzhen@devgpu093.cco2.facebook.com>
Co-authored-by: yZhen <yZhen@fb.com>
Co-authored-by: yzhen <yzhen@devgpu093.cco2.facebook.com>

ebb1ec93

01 Jun, 2025 1 commit
- Let max_num_batched_tokens use human_readable_int for large numbers (#18968) · 2ad6194a
  Michael Goin authored May 31, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  2ad6194a
30 May, 2025 1 commit
- [Bugfix] Fix PP default fallback behavior for V1 (#18915) · d54af615
  Michael Goin authored May 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d54af615
28 May, 2025 4 commits
- [V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837) · 0e98964e
  Mark McLoughlin authored May 28, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  0e98964e
- [Core] Add Lora Support to Beam Search (#18346) · 321331b8
  Alex Brooks authored May 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  321331b8
- Enable Pydantic mypy checks and convert configs to Pydantic dataclasses (#17599) · 4c2b38ce
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4c2b38ce
- [Deprecation] Remove unused sync methods in `async_timeout` (#18792) · 0f0926b4
  Cyrus Leung authored May 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f0926b4
27 May, 2025 2 commits

[Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c

Hyogeun Oh (오효근) authored May 27, 2025


[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>

a68e293c

[V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) · 1f1b1bc0
Isotr0py authored May 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
1f1b1bc0

25 May, 2025 1 commit
- [Bugfix] Fix cpu usage and cache hit stats reporting on cpu environment (#18674) · f2faac74
  Yuqi Zhang authored May 25, 2025
```
Signed-off-by: zzzyq <zhangyuqi94@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  f2faac74