Commits · 70788bdbdc590e7fbf9bddb3fa9bc92ac3181733 · OpenDAS / vllm_cscc

29 Apr, 2025 1 commit
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
28 Apr, 2025 1 commit

[Model] Add Granite Speech Support (#16246) · fa93cd9f

Alex Brooks authored Apr 28, 2025


Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>

fa93cd9f

26 Apr, 2025 2 commits
- [Bugfix] Fix missing int type for `-n` in multi-image example (#17223) · 8c1c926d
  Isotr0py authored Apr 26, 2025
  
  8c1c926d
- [v1] [P/D] Adding LMCache KV connector for v1 (#16625) · 5e83a727
  Yihua Cheng authored Apr 25, 2025
  
  5e83a727
25 Apr, 2025 1 commit

[V1][Spec Decode] EAGLE-3 Support (#16937) · a0e619e6

Benjamin Chislett authored Apr 25, 2025


Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Bryan Lu <yuzhelu@amazon.com>

a0e619e6

19 Apr, 2025 3 commits

[VLM] Clean up models (#16873) · 205d84aa
Cyrus Leung authored Apr 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
205d84aa

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) · 83f3c3bd

Isotr0py authored Apr 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

83f3c3bd

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) · 2c1bd848

Yang Fan authored Apr 19, 2025


Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>

2c1bd848

18 Apr, 2025 3 commits
- [Misc] Clean up Kimi-VL (#16833) · aadb6565
  Cyrus Leung authored Apr 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aadb6565
- Improve-mm-and-pooler-and-decoding-configs (#16789) · e78587a6
  Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e78587a6
- [Misc] Update outdated note: LMCache now supports chunked prefill (#16697) · 7a4a5de7
  Chauncey authored Apr 18, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  7a4a5de7
17 Apr, 2025 4 commits

[P/D][V1] KV Connector API V1 (#15960) · 3408e471

Yihua Cheng authored Apr 17, 2025


Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

3408e471

[Misc] refactor examples series - lmcache (#16758) · 99ed5261

Reid authored Apr 17, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

99ed5261

[Ray] Improve documentation on batch inference (#16609) · 8cac35ba
Richard Liaw authored Apr 16, 2025
```
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
```
8cac35ba
[Bugfix] Update Florence-2 tokenizer to make grounding tasks work (#16734) · cb072ce9
Isotr0py authored Apr 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
cb072ce9

16 Apr, 2025 1 commit

[Misc] refactor examples series (#16708) · 71689204

Reid authored Apr 16, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

71689204

15 Apr, 2025 1 commit

[Misc] refactor argument parsing in examples (#16635) · 6ae996a8

Reid authored Apr 15, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

6ae996a8

14 Apr, 2025 2 commits
- [Model][VLM] Add Kimi-VL model support (#16387) · b1308b84
  courage17340 authored Apr 15, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  b1308b84
- [Misc] refactor examples (#16563) · 7cbfc109
  Reid authored Apr 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  7cbfc109
12 Apr, 2025 3 commits
- [Misc] Delete redundant code (#16530) · 3cdc5766
  Jee Jee Li authored Apr 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3cdc5766
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
- [Frontend] support matryoshka representation / support embedding API dimensions (#16331) · fbf722c6
  wang.yuqi authored Apr 12, 2025
  
  fbf722c6
11 Apr, 2025 1 commit
- [Bugfix][VLM] Fix failing Phi-4-MM multi-images tests and add vision-speech test (#16424) · 93195146
  Isotr0py authored Apr 11, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  93195146
10 Apr, 2025 2 commits
- [V1][Spec Decode] Eagle Model loading (#16035) · e8224f3d
  Lily Liu authored Apr 10, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  e8224f3d
- [Model] Remove image mm limit for LLaMa4 (#16365) · 61de3ef7
  Ye (Charlotte) Qi authored Apr 10, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  61de3ef7
09 Apr, 2025 3 commits
- [Misc] refactor Structured Outputs example (#16322) · 1bff42c4
  Reid authored Apr 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1bff42c4
- [Bugfix] Fix profiling.py (#16202) · a25866ac
  zh Wang authored Apr 10, 2025
```
Signed-off-by: zh Wang <rekind133@outlook.com>
```
  a25866ac
- [Model] Add smolvlm support (#16017) · 102bf967
  Chauncey authored Apr 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  102bf967
08 Apr, 2025 4 commits
- [V1] Update structured output offline inference example (#15721) · 2755c34a
  Russell Bryant authored Apr 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  2755c34a
- [Bugfix] Proper input validation for multi-modal encoder-decoder models (#16156) · 4ebc0b96
  Cyrus Leung authored Apr 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4ebc0b96
- [New Model]: jinaai/jina-embeddings-v3 (#16120) · 1f5d13ab
  wang.yuqi authored Apr 08, 2025
  
  1f5d13ab
- [Misc] format and refactor some examples (#16252) · 7f00899f
  Reid authored Apr 08, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  7f00899f
07 Apr, 2025 3 commits

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

55dcce91

[Misc] improve example mlpspeculator and llm_engine_example (#16175) · dc3529db
Reid authored Apr 07, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
dc3529db
[Misc] Update Mistral-3.1 example (#16147) · 0a573867
Cyrus Leung authored Apr 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0a573867

06 Apr, 2025 2 commits

[Misc] refactor example eagle (#16100) · b6c502a1

Reid authored Apr 06, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

b6c502a1

[Misc] format output for encoder_decoder.py (#16095) · d8f094a9

Reid authored Apr 06, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

d8f094a9

04 Apr, 2025 2 commits

Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
Roger Wang authored Apr 04, 2025

af51d80f

[V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50

Cyrus Leung authored Apr 05, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

f5722a50

03 Apr, 2025 1 commit
- [Bugfix][V1] Fix bug from putting llm_engine.model_executor in a background process (#15367) · 463bbb18
  wwl2755 authored Apr 03, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  463bbb18