Commits · eca18691d2fe29c4f6c1b466709eda9f123116ea · OpenDAS / vllm_cscc

21 May, 2025 2 commits

Dhia Eddine Rhaiem authored May 21, 2025


Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>

eca18691

[Frontend] deprecate `--device` arg (#18399) · 5d7f5452
Kebe authored May 21, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
5d7f5452

20 May, 2025 2 commits

[Misc] refactor prompt embedding examples (#18405) · 8f55962a

Reid authored May 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

8f55962a

[doc] update env variable export (#18391) · 1b1e8e05

Reid authored May 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

1b1e8e05

19 May, 2025 4 commits

[Doc] Fix typo (#18355) · 84ab4feb
Elad Segal authored May 19, 2025

84ab4feb
[Doc] Move input-related docs to Features (#18353) · 43b5f61d
Cyrus Leung authored May 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
43b5f61d
[Doc] Fix prompt embedding examples (#18350) · c5bb0ebd
Li Wang authored May 19, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
c5bb0ebd

Feature/vllm/input embedding completion api (#17590) · 221cfc2f

Nan Qin authored May 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

221cfc2f

18 May, 2025 3 commits
- [Doc] Add doc to explain the usage of Qwen3 thinking (#18291) · d1211f87
  Robin authored May 19, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d1211f87
- [Misc] add litellm integration (#18320) · b6a6e7a5
  Reid authored May 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b6a6e7a5
- [doc] update reasoning doc (#18306) · 1a8f68bb
  Reid authored May 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1a8f68bb
17 May, 2025 1 commit
- Move cli args docs to its own page (#18228) (#18264) · 55f1a468
  Trevor Royer authored May 16, 2025
```
Signed-off-by: Trevor Royer <troyer@redhat.com>
```
  55f1a468
15 May, 2025 2 commits
- [Misc] add lobe-chat support (#18177) · 2dff0935
  Reid authored May 15, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2dff0935
- [Chore] astral's ty (#18116) · afe3236e
  Aaron Pham authored May 15, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  afe3236e
14 May, 2025 5 commits
- [V1] Structured Outputs + Thinking compatibility (#16577) · 2fc9075b
  Aaron Pham authored May 14, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  2fc9075b
- [Doc] Update prefix cache metrics to counting tokens (#18138) · 964472b9
  Chen Zhang authored May 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  964472b9
- [doc] add missing import (#18133) · 9ccc6ded
  Reid authored May 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  9ccc6ded
- [Misc] replace does not exist model (#18119) · 82e7f9bb
  rongfu.leng authored May 14, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  82e7f9bb
- [New Model]: support GTE NewModel (#17986) · 63ad6222
  wang.yuqi authored May 14, 2025
  
  63ad6222
13 May, 2025 2 commits
- [Docs] Expand security doc with firewall info (#18081) · 0189a65a
  Russell Bryant authored May 13, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  0189a65a
- [doc] add download/list/delete HF model CLI usage (#17940) · 906f0598
  Reid authored May 13, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  906f0598
12 May, 2025 4 commits
- [Model] Support MiMo-7B inference with MTP (#17433) · acee8f48
  bwshen-mi authored May 13, 2025
```
Signed-off-by: wp-alpha <wangpeng66@xiaomi.com>
Co-authored-by: wangpeng66 <wangpeng66@xiaomi.com>
```
  acee8f48
- [Lora][Frontend]Add default local directory LoRA resolver plugin. (#16855) · 98ea3560
  Jonathan Berkhahn authored May 12, 2025
```
Signed-off-by: jberkhahn <jaberkha@us.ibm.com>
```
  98ea3560
- [Feature] Support DeepSeekV3 Function Call (#17784) · 3a5ea751
  Xu Wenqing authored May 12, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  3a5ea751
- [Model] Broadcast Ovis2 implementation to fit Ovis1.6 (#17861) · 021c16c7
  Isotr0py authored May 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  021c16c7
11 May, 2025 3 commits
- [New Model]: nomic-embed-text-v2-moe (#17785) · e4b87133
  wang.yuqi authored May 11, 2025
  
  e4b87133
- [Frontend] Add /classify endpoint (#17032) · 9cea90ea
  Frieda Huang authored May 11, 2025
```
Signed-off-by: Frieda (Jingying) Huang <jingyingfhuang@gmail.com>
```
  9cea90ea
- [doc] update lora doc (#17936) · d1110f5b
  Reid authored May 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d1110f5b
09 May, 2025 4 commits
- [Misc] add dify integration (#17895) · ec61ea20
  Reid authored May 09, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  ec61ea20
- [Doc] remove visible token in doc (#17884) · ff8c4005
  Yan Ma authored May 09, 2025
```
Signed-off-by: yan <yanma1@habana.ai>
```
  ff8c4005
- [Doc] Update several links in reasoning_outputs.md (#17846) · 89a0315f
  Michael Yao authored May 09, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  89a0315f
- [Docs] Add Slides from NYC Meetup (#17879) · 3d1e3876
  Simon Mo authored May 08, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  3d1e3876
08 May, 2025 4 commits
- [Misc] add chatbox integration (#17828) · 53d0cb74
  Reid authored May 08, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  53d0cb74
- [Frontend] Chat template fallbacks for multimodal models (#17805) · 96722aa8
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96722aa8
- [Core] Support full cuda graph in v1 (#16072) · 7ea2adb8
  Chanh Nguyen authored May 07, 2025
```
Signed-off-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
```
  7ea2adb8
- Don't call the venv `vllm` (#17810) · 66ab3b13
  Harry Mellor authored May 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  66ab3b13
07 May, 2025 3 commits
- [doc] update the issue link (#17782) · 7377dd03
  Reid authored May 07, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  7377dd03
- [Frontend] Add missing chat templates for various MLLMs (#17758) · 8a15c260
  Cyrus Leung authored May 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a15c260
- Fix doc build performance (#17748) · 022afbeb
  Harry Mellor authored May 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  022afbeb
06 May, 2025 1 commit
- Make right sidebar more readable in "Supported Models" (#17723) · 6115b115
  Harry Mellor authored May 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6115b115