Commits · 67309a1cb55f865f745b36501707f9f73bb023cc · OpenDAS / vllm_cscc

24 Apr, 2025 5 commits
- [Frontend] Using matryoshka_dimensions control the allowed output dimensions. (#16970) · 67309a1c
  wang.yuqi authored Apr 24, 2025
  
  67309a1c
- Add docs for runai_streamer_sharded (#17093) · 2bc0f72a
  omer-dayan authored Apr 24, 2025
```
Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  2bc0f72a
- [doc] update to hyperlink (#17096) · 9c1244de
  Reid authored Apr 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  9c1244de
- [V1] Update structured output (#16812) · db2f8d91
  Reid authored Apr 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  db2f8d91
- More informative error when using Transformers backend (#16988) · 2c8ed8ee
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2c8ed8ee
23 Apr, 2025 2 commits
- [Doc] Add top anchor and a note to quantization/bitblas.md (#17042) · f7912cba
  Michael Yao authored Apr 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  f7912cba
- [doc] add download path tips (#17013) · eb8ef422
  Reid authored Apr 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  eb8ef422
22 Apr, 2025 3 commits
- [Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036) · 8d32dc60
  Lei Wang authored Apr 22, 2025
```
Signed-off-by: xinyuxiao <xinyuxiao2024@gmail.com>
Co-authored-by: xinyuxiao <xinyuxiao2024@gmail.com>
```
  8d32dc60
- [Doc] Update ai_accelerator/hpu-gaudi.inc.md (#16956) · 3097ce3a
  Michael Yao authored Apr 22, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  3097ce3a
- [Doc] Remove unnecessary V1 flag (#16924) · 29f395c9
  Cyrus Leung authored Apr 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  29f395c9
21 Apr, 2025 4 commits
- [Doc] mention how to install in CPU editable mode (#16923) · f728ab8e
  David Xia authored Apr 21, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  f728ab8e
- [doc] install required python3-dev apt package (#16888) · 63e26fff
  David Xia authored Apr 21, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  63e26fff
- [XPU][Bugfix] minor fix for XPU (#15591) · fe3462c7
  Yan Ma authored Apr 22, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  fe3462c7
- [Doc] Split dummy_processor_inputs() in Multimodal Docs (#16915) · b34f3343
  Alex Brooks authored Apr 21, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  b34f3343
19 Apr, 2025 5 commits

[doc] update hyperlink (#16877) · d6195a74

Reid authored Apr 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

d6195a74

[Model] Qwen2.5-Omni Cleanup (#16872) · 5124f5bf
Roger Wang authored Apr 19, 2025

5124f5bf

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) · 83f3c3bd

Isotr0py authored Apr 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

83f3c3bd

[Frontend] Add sampling params to `v1/audio/transcriptions` endpoint (#16591) · 2ef0dc53

Nicolò Lucchesi authored Apr 19, 2025


Signed-off-by: Jannis Schönleber <joennlae@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Jannis Schönleber <joennlae@gmail.com>

2ef0dc53

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) · 2c1bd848

Yang Fan authored Apr 19, 2025


Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>

2c1bd848

18 Apr, 2025 5 commits
- [Doc] Updated Llama section in tool calling docs to have llama 3.2 config info (#16857) · 490b1698
  Justin Ho authored Apr 18, 2025
```
Signed-off-by: jmho <jaylenho734@gmail.com>
```
  490b1698
- [Docs] Fix a link and grammar issue in production-stack.md (#16809) · 26507f89
  Michael Yao authored Apr 18, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  26507f89
- [Doc] add podman setup instructions for official image (#16796) · 9c1d5b45
  Nathan Weinberg authored Apr 18, 2025
```
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
```
  9c1d5b45
- Improve-mm-and-pooler-and-decoding-configs (#16789) · e78587a6
  Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e78587a6
- [Doc] Improve help examples for `--compilation-config` (#16729) · c16fb5da
  Cyrus Leung authored Apr 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c16fb5da
17 Apr, 2025 10 commits
- [V1][Metrics] Fix http metrics middleware (#15894) · e4755f7f
  Mark McLoughlin authored Apr 17, 2025
  
  e4755f7f
- [Doc] Changed explanation of generation_tokens_total and prompt_tokens_total... · 7c02d6a1
  Insu Kim authored Apr 17, 2025
```
[Doc] Changed explanation of generation_tokens_total and prompt_tokens_total counter type metrics to avoid confusion (#16784)
Signed-off-by: insukim1994 <insu.kim@moreh.io>
```
  7c02d6a1
- [Doc] Document Matryoshka Representation Learning support (#16770) · 11c3b984
  wang.yuqi authored Apr 17, 2025
  
  11c3b984
- [Doc] Make sure to update vLLM when installing latest code (#16781) · dbe7f070
  Cyrus Leung authored Apr 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dbe7f070
- fix: hyperlink (#16778) · c69bf4ee
  Reid authored Apr 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  c69bf4ee
- [Doc] Fix a 404 link in installation/cpu.md (#16773) · 207da281
  Michael Yao authored Apr 17, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  207da281
- [Bugfix] Fix GLM4 model (#16618) · 5b1aca2a
  intervitens authored Apr 17, 2025
```
Signed-off-by: intervitens <intervitens@tutanota.com>
```
  5b1aca2a
- [doc] add open-webui example (#16747) · d8e557b5
  Reid authored Apr 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d8e557b5
- [Doc] Add more tips to avoid OOM (#16765) · 61a44a0b
  Cyrus Leung authored Apr 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61a44a0b
- Help user create custom model for Transformers backend remote code models (#16719) · 3cd91dc9
  Harry Mellor authored Apr 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3cd91dc9
16 Apr, 2025 3 commits

[Model] support modernbert (#16648) · ee378f3d

xsank authored Apr 16, 2025


Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com>

ee378f3d

[Doc] Improve OOM troubleshooting (#16704) · facbe2a1
Cyrus Leung authored Apr 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
facbe2a1

[Model] Add PLaMo2 (#14323) · 3badb021

Shinichi Hemmi authored Apr 16, 2025


Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Signed-off-by: shemmi <shemmi@preferred.jp>
Co-authored-by: Kento Nozawa <nzw0301@preferred.jp>
Co-authored-by: Hiroaki Mikami <mhiroaki@preferred.jp>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>

3badb021

15 Apr, 2025 1 commit

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) · fdcb850f

Angky William authored Apr 15, 2025


Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>

fdcb850f

14 Apr, 2025 1 commit
- [Model][VLM] Add Kimi-VL model support (#16387) · b1308b84
  courage17340 authored Apr 15, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  b1308b84
12 Apr, 2025 1 commit
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9