Commits · eb07c8cb5b72f08291886ffa4d5d7b19af59c7a2 · OpenDAS / vllm_cscc

06 Apr, 2025 2 commits
- [Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501) · eb07c8cb
  Ben Jackson authored Apr 06, 2025
```
Signed-off-by: Ben Jackson <ben@ben.com>
```
  eb07c8cb
- [Misc] format output for encoder_decoder.py (#16095) · d8f094a9
  Reid authored Apr 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d8f094a9
04 Apr, 2025 2 commits

Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
Roger Wang authored Apr 04, 2025

af51d80f

[V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50

Cyrus Leung authored Apr 05, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

f5722a50

03 Apr, 2025 2 commits
- [Bugfix][V1] Fix bug from putting llm_engine.model_executor in a background process (#15367) · 463bbb18
  wwl2755 authored Apr 03, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  463bbb18
- [bugfix] add seed in torchrun_example.py (#15980) · 8b664706
  youkaichao authored Apr 03, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8b664706
02 Apr, 2025 1 commit

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a

01 Apr, 2025 3 commits

[Model] Aya Vision (#15441) · 38327cf4

Jennifer Zhao authored Apr 01, 2025


Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

38327cf4

[Model] Support Mistral3 in the HF Transformers format (#15505) · 51d7c6a2

Michael Goin authored Apr 01, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

51d7c6a2

[Frontend] Add Phi-4-mini function calling support (#14886) · a164aea3

Kinfey authored Apr 01, 2025


Signed-off-by: Kinfey <kinfeylo@microsoft.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

a164aea3

31 Mar, 2025 2 commits
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
29 Mar, 2025 3 commits
- [Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
  Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  3c0ff914
- [Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957) · 6fa7cd3d
  shangmingc authored Mar 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6fa7cd3d
- [Model] Support Skywork-R1V (#15397) · de1cb387
  pengyuange authored Mar 29, 2025
```
Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>
```
  de1cb387
27 Mar, 2025 2 commits
- [V1] AsyncLLM data parallel (#13923) · 15dac210
  Nick Hill authored Mar 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  15dac210
- [TPU] [V1] fix cases when max_num_reqs is set smaller than MIN_NUM_SEQS (#15583) · 619d3de8
  Chengji Yao authored Mar 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  619d3de8
26 Mar, 2025 3 commits
- multi-node offline DP+EP example (#15484) · e64afa45
  youkaichao authored Mar 26, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  e64afa45
- [Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
  Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
  1711b929
- [Misc] improve example script output (#15528) · 4ec2cee0
  Reid authored Mar 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  4ec2cee0
25 Mar, 2025 1 commit
- [Misc] Clean up MiniCPM-V/O code (#15337) · a9e879b3
  Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a9e879b3
23 Mar, 2025 2 commits
- [Frontend] Support tool calling and reasoning parser (#14511) · d6cd59f1
  Robin authored Mar 24, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d6cd59f1
- [V1][Usage] Refactor speculative decoding configuration and tests (#14434) · 50c9636d
  shangmingc authored Mar 23, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50c9636d
22 Mar, 2025 1 commit

[Model] Support Tele-FLM Model (#15023) · 2f4bd358

Naitong Yu authored Mar 22, 2025


Signed-off-by: Naitong Yu <ntyu@baai.ac.cn>
Signed-off-by: jiangxin <horizon94@outlook.com>
Co-authored-by: Jason Fang <jasonfang3900@gmail.com>
Co-authored-by: jiangxin <horizon94@outlook.com>

2f4bd358

21 Mar, 2025 2 commits
- Add an example for reproducibility (#15262) · e588ac23
  Woosuk Kwon authored Mar 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e588ac23
- [Misc] Clean up the BitsAndBytes arguments (#15140) · 10f55fe6
  Jee Jee Li authored Mar 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  10f55fe6
20 Mar, 2025 3 commits
- [Frontend][Bugfix] support prefill decode disaggregation on deepseek (#14824) · 742369d3
  billishyahao authored Mar 20, 2025
```
Signed-off-by: billishyahao <bill.he@amd.com>
Co-authored-by: Zhai Feiyue <80079571+ZhaiFeiyue@users.noreply.github.com>
```
  742369d3
- [Doc] Update Mistral Small 3.1/Pixtral example (#15184) · 34868b10
  Roger Wang authored Mar 19, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  34868b10
- [Bugfix] Fix embedding assignment for InternVL-based models (#15086) · ffa443af
  Cyrus Leung authored Mar 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ffa443af
18 Mar, 2025 2 commits
- [Bugfix] Fix LoRA extra vocab size (#15047) · 46c759c1
  Jee Jee Li authored Mar 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  46c759c1
- [Mistral-Small 3.1] Update docs and tests (#14977) · f863ffc9
  Patrick von Platen authored Mar 18, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f863ffc9
17 Mar, 2025 1 commit
- [Misc] Add `--seed` option to offline multi-modal examples (#14934) · 6eaf1e5c
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6eaf1e5c
16 Mar, 2025 1 commit
- [BugFix] Fix torch distributed stateless PG backend init (#14870) · b82662d9
  Nick Hill authored Mar 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b82662d9
15 Mar, 2025 2 commits

[VLM] Merged multi-modal processor for Pixtral (#12211) · 61c6a5a7

Rémi Delacourt authored Mar 15, 2025


Signed-off-by: remi <remi@mistral.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

61c6a5a7

[Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
9ed6ee92

14 Mar, 2025 2 commits
- [Bugfix] Fix small typo in the example of Streaming delimiter (#14793) · 54cc46f3
  WeiCheng authored Mar 14, 2025
  
  54cc46f3
- [Doc] Fix typo in documentation (#14783) · 3fb17d26
  yasu52 authored Mar 13, 2025
```
Signed-off-by: yasu52 <tsuguro4649@gmail.com>
```
  3fb17d26
13 Mar, 2025 1 commit

[VLM] Support pan-and-scan for Gemma3 multi-modal processor (#14672) · 38240392

Cyrus Leung authored Mar 13, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>

38240392

12 Mar, 2025 1 commit

[Model] Add support for Gemma 3 (#14660) · c0c25e25

Woosuk Kwon authored Mar 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c0c25e25

11 Mar, 2025 1 commit
- [Misc] Correct deepseek-vl2 chat template (#14558) · 63d635d1
  Isotr0py authored Mar 11, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  63d635d1