Commits · 205d84aaa974d6c7752705bb2835bac6809794cc · OpenDAS / vllm_cscc

19 Apr, 2025 4 commits

[Model] Qwen2.5-Omni Cleanup (#16872) · 5124f5bf
Roger Wang authored Apr 19, 2025

5124f5bf

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) · 83f3c3bd

Isotr0py authored Apr 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

83f3c3bd

[Frontend] Add sampling params to `v1/audio/transcriptions` endpoint (#16591) · 2ef0dc53

Nicolò Lucchesi authored Apr 19, 2025


Signed-off-by: Jannis Schönleber <joennlae@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Jannis Schönleber <joennlae@gmail.com>

2ef0dc53

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) · 2c1bd848

Yang Fan authored Apr 19, 2025


Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>

2c1bd848

18 Apr, 2025 5 commits
- [Doc] Updated Llama section in tool calling docs to have llama 3.2 config info (#16857) · 490b1698
  Justin Ho authored Apr 18, 2025
```
Signed-off-by: jmho <jaylenho734@gmail.com>
```
  490b1698
- [Docs] Fix a link and grammar issue in production-stack.md (#16809) · 26507f89
  Michael Yao authored Apr 18, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  26507f89
- [Doc] add podman setup instructions for official image (#16796) · 9c1d5b45
  Nathan Weinberg authored Apr 18, 2025
```
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
```
  9c1d5b45
- Improve-mm-and-pooler-and-decoding-configs (#16789) · e78587a6
  Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e78587a6
- [Doc] Improve help examples for `--compilation-config` (#16729) · c16fb5da
  Cyrus Leung authored Apr 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c16fb5da
17 Apr, 2025 10 commits
- [V1][Metrics] Fix http metrics middleware (#15894) · e4755f7f
  Mark McLoughlin authored Apr 17, 2025
  
  e4755f7f
- [Doc] Changed explanation of generation_tokens_total and prompt_tokens_total... · 7c02d6a1
  Insu Kim authored Apr 17, 2025
```
[Doc] Changed explanation of generation_tokens_total and prompt_tokens_total counter type metrics to avoid confusion (#16784)
Signed-off-by: insukim1994 <insu.kim@moreh.io>
```
  7c02d6a1
- [Doc] Document Matryoshka Representation Learning support (#16770) · 11c3b984
  wang.yuqi authored Apr 17, 2025
  
  11c3b984
- [Doc] Make sure to update vLLM when installing latest code (#16781) · dbe7f070
  Cyrus Leung authored Apr 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dbe7f070
- fix: hyperlink (#16778) · c69bf4ee
  Reid authored Apr 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  c69bf4ee
- [Doc] Fix a 404 link in installation/cpu.md (#16773) · 207da281
  Michael Yao authored Apr 17, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  207da281
- [Bugfix] Fix GLM4 model (#16618) · 5b1aca2a
  intervitens authored Apr 17, 2025
```
Signed-off-by: intervitens <intervitens@tutanota.com>
```
  5b1aca2a
- [doc] add open-webui example (#16747) · d8e557b5
  Reid authored Apr 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d8e557b5
- [Doc] Add more tips to avoid OOM (#16765) · 61a44a0b
  Cyrus Leung authored Apr 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61a44a0b
- Help user create custom model for Transformers backend remote code models (#16719) · 3cd91dc9
  Harry Mellor authored Apr 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3cd91dc9
16 Apr, 2025 3 commits

[Model] support modernbert (#16648) · ee378f3d

xsank authored Apr 16, 2025


Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com>

ee378f3d

[Doc] Improve OOM troubleshooting (#16704) · facbe2a1
Cyrus Leung authored Apr 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
facbe2a1

[Model] Add PLaMo2 (#14323) · 3badb021

Shinichi Hemmi authored Apr 16, 2025


Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Signed-off-by: shemmi <shemmi@preferred.jp>
Co-authored-by: Kento Nozawa <nzw0301@preferred.jp>
Co-authored-by: Hiroaki Mikami <mhiroaki@preferred.jp>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>

3badb021

15 Apr, 2025 1 commit

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) · fdcb850f

Angky William authored Apr 15, 2025


Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>

fdcb850f

14 Apr, 2025 1 commit
- [Model][VLM] Add Kimi-VL model support (#16387) · b1308b84
  courage17340 authored Apr 15, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  b1308b84
12 Apr, 2025 2 commits
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
- [Doc] Update Llama4 Model Names in Supported Models (#16509) · 802329de
  Ye (Charlotte) Qi authored Apr 11, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  802329de
11 Apr, 2025 4 commits
- Update openai_compatible_server.md (#16507) · c09632a6
  Christian Sears authored Apr 11, 2025
```
Signed-off-by: Christian Sears <csears@redhat.com>
```
  c09632a6
- [Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463) · 16eda8c4
  Ye (Charlotte) Qi authored Apr 11, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Kai Wu <kaiwu@meta.com>
```
  16eda8c4
- [Doc] Document InternVL3 support (#16495) · 5285589f
  Isotr0py authored Apr 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5285589f
- Update supported_hardware.md for TPU INT8 (#16437) · ed375995
  Michael Goin authored Apr 10, 2025
  
  ed375995
10 Apr, 2025 4 commits

[VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
83b824c8

[doc] update the wrong link (#16401) · ce8d6b75

Reid authored Apr 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

ce8d6b75

[doc] add download model tips (#16389) · 65e09094

Reid authored Apr 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

65e09094

Add GLM-4-0414 support (#16338) · 1e44ffc3

Yuxuan Zhang authored Apr 10, 2025


Signed-off-by: lvfei.lv <lvfei.lv@alibaba-inc.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Ajay Vohra <ajayvohr@amazon.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Accelerator1996 <lvfei.lv@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: ajayvohra2005 <ajayvohr@amazon.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>

1e44ffc3

09 Apr, 2025 2 commits
- [Model] Add `SupportsMultiModal.get_language_model` interface (#16007) · d55244df
  Nicolò Lucchesi authored Apr 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d55244df
- [Model] Add smolvlm support (#16017) · 102bf967
  Chauncey authored Apr 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  102bf967
08 Apr, 2025 2 commits

[Docs] Add Slides from Singapore Meetup (#16213) · 995e3d1f
Simon Mo authored Apr 08, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
995e3d1f

[V1] Scatter and gather placeholders in the model runner (#16076) · f2ebb6f5

Roger Wang authored Apr 07, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>

f2ebb6f5

07 Apr, 2025 2 commits
- Torchao (#14231) · 652907b3
  Driss Guessous authored Apr 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  652907b3
- [V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158) · 66d433b9
  Cyrus Leung authored Apr 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  66d433b9