Commits · 16eda8c43a9d62f3dc90e8a0149855b3820049c8 · OpenDAS / vllm_cscc

11 Apr, 2025 3 commits
- [Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463) · 16eda8c4
  Ye (Charlotte) Qi authored Apr 11, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Kai Wu <kaiwu@meta.com>
```
  16eda8c4
- [Doc] Document InternVL3 support (#16495) · 5285589f
  Isotr0py authored Apr 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5285589f
- Update supported_hardware.md for TPU INT8 (#16437) · ed375995
  Michael Goin authored Apr 10, 2025
  
  ed375995
10 Apr, 2025 4 commits

[VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
83b824c8

[doc] update the wrong link (#16401) · ce8d6b75

Reid authored Apr 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

ce8d6b75

[doc] add download model tips (#16389) · 65e09094

Reid authored Apr 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

65e09094

Add GLM-4-0414 support (#16338) · 1e44ffc3

Yuxuan Zhang authored Apr 10, 2025


Signed-off-by: lvfei.lv <lvfei.lv@alibaba-inc.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Ajay Vohra <ajayvohr@amazon.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Accelerator1996 <lvfei.lv@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: ajayvohra2005 <ajayvohr@amazon.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>

1e44ffc3

09 Apr, 2025 2 commits
- [Model] Add `SupportsMultiModal.get_language_model` interface (#16007) · d55244df
  Nicolò Lucchesi authored Apr 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d55244df
- [Model] Add smolvlm support (#16017) · 102bf967
  Chauncey authored Apr 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  102bf967
08 Apr, 2025 2 commits

[Docs] Add Slides from Singapore Meetup (#16213) · 995e3d1f
Simon Mo authored Apr 08, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
995e3d1f

[V1] Scatter and gather placeholders in the model runner (#16076) · f2ebb6f5

Roger Wang authored Apr 07, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>

f2ebb6f5

07 Apr, 2025 7 commits

Torchao (#14231) · 652907b3
Driss Guessous authored Apr 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
652907b3
[V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158) · 66d433b9
Cyrus Leung authored Apr 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
66d433b9
[Bugfix] Re-enable support for `ChatGLMForConditionalGeneration` (#16187) · 027b204f
Cyrus Leung authored Apr 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
027b204f

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

55dcce91

[Doc]Update image to latest version (#16186) · 8017c8db
Robin authored Apr 07, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
8017c8db

[Model] Add Qwen3 and Qwen3MoE (#15289) · 7699258e

YamPengLi authored Apr 07, 2025


Signed-off-by: YamPengLi <yampayne.lyp@alibaba-inc.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

7699258e

doc: fix some typos in doc (#16154) · 95d63f38
yihong authored Apr 07, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
95d63f38

06 Apr, 2025 1 commit
- [Doc][Bugfix] Add missing EOF in k8s deploy doc (#16025) · d5ae4f7f
  Paul Schweigert authored Apr 06, 2025
  
  d5ae4f7f
05 Apr, 2025 4 commits
- Fix some capitalisations in generated examples doc titles (#16094) · 97ae6d77
  Harry Mellor authored Apr 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97ae6d77
- Revert "doc: add info for macos clang errors (#16049)" (#16091) · 6baeee70
  yihong authored Apr 05, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  6baeee70
- [doc] fix 404 (#16082) · d2517a49
  Reid authored Apr 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d2517a49
- [Misc] Auto detect bitsandbytes pre-quantized models (#16027) · 4285e423
  Tristan Leclercq authored Apr 05, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  4285e423
04 Apr, 2025 3 commits
- Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
  Roger Wang authored Apr 04, 2025
  
  af51d80f
- [V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50
  Cyrus Leung authored Apr 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f5722a50
- doc: add info for macos clang errors (#16049) · 4ef0bb1f
  yihong authored Apr 04, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  4ef0bb1f
02 Apr, 2025 6 commits
- [V1] Support Mistral3 in V1 (#15950) · f021b979
  Michael Goin authored Apr 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f021b979
- [Model] use AutoWeightsLoader in model load_weights (#15770) · e86c414d
  rongfu.leng authored Apr 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  e86c414d
- [CPU][Bugfix] Using custom allreduce for CPU backend (#15934) · 550b2801
  Li, Jiang authored Apr 02, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  550b2801
- [Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a
  Matthias Matt authored Apr 02, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  cefb9e5a
- [Doc] Update rocm.inc.md (#15917) · c920e012
  chun authored Apr 02, 2025
```
Signed-off-by: chun37 <chun.jb.37@gmail.com>
```
  c920e012
- [Docs] Add Intel as Sponsor (#15913) · 58f5a597
  Simon Mo authored Apr 01, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  58f5a597
01 Apr, 2025 8 commits

[Docs] Add Ollama meetup slides (#15905) · db9dfcfa
Simon Mo authored Apr 01, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
db9dfcfa

[Model][MiniMaxText01] Support MiniMaxText01 model inference (#13454) · 9ef98d52

Gerald authored Apr 02, 2025


Signed-off-by: qscqesze <475517977@qq.com>
Co-authored-by: qingjun <qingjun@minimaxi.com>
Co-authored-by: qscqesze <475517977@qq.com>

9ef98d52

[Docs] update usage stats language (#15898) · 7acd539c
Simon Mo authored Apr 01, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
7acd539c

[Model] Aya Vision (#15441) · 38327cf4

Jennifer Zhao authored Apr 01, 2025


Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

38327cf4

[Doc] Quark quantization documentation (#15861) · 2041c0e3
chaow-amd authored Apr 01, 2025
```
Signed-off-by: chaow <chaow@amd.com>
```
2041c0e3

[New Model]: jinaai/jina-reranker-v2-base-multilingual (#15876) · 085cbc4f

wang.yuqi authored Apr 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

085cbc4f

[Model] Support Mistral3 in the HF Transformers format (#15505) · 51d7c6a2

Michael Goin authored Apr 01, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

51d7c6a2

[Docs] Fix small error in link text (#15868) · d330558b
Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d330558b