Commits · 04149cce2775a5d7ba4ec5dec693003f81e58cba · OpenDAS / vllm_cscc

09 Apr, 2025 3 commits
- [BugFix] llama4 qknorm should be not shared across head (#16311) · ec7da6fc
  Lucia Fang authored Apr 09, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  ec7da6fc
- [Model] Add smolvlm support (#16017) · 102bf967
  Chauncey authored Apr 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  102bf967
- Add support to modelopt quantization of Mixtral model (#15961) · 1f4b09b5
  yueshen2016 authored Apr 08, 2025
```
Signed-off-by: Yue <yueshen@nvidia.com>
```
  1f4b09b5
08 Apr, 2025 4 commits

[Bugfix] fix deepseek fp16 scale bug (#14809) · db104221

Jinzhen Lin authored Apr 09, 2025


Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

db104221

[New Model]: jinaai/jina-embeddings-v3 (#16120) · 1f5d13ab
wang.yuqi authored Apr 08, 2025

1f5d13ab
[Model] use AutoWeightsLoader for phimoe,qwen2_moe,qwen3_moe (#16203) · 5a1e1c83
rongfu.leng authored Apr 08, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
5a1e1c83

[V1] Scatter and gather placeholders in the model runner (#16076) · f2ebb6f5

Roger Wang authored Apr 07, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>

f2ebb6f5

07 Apr, 2025 6 commits

[Misc] Move Llama 4 projector call into encoder execution (#16201) · ed636d99
Roger Wang authored Apr 07, 2025

ed636d99
[Bugfix] Re-enable support for `ChatGLMForConditionalGeneration` (#16187) · 027b204f
Cyrus Leung authored Apr 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
027b204f

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

55dcce91

[Model] Add Qwen3 and Qwen3MoE (#15289) · 7699258e

YamPengLi authored Apr 07, 2025


Signed-off-by: YamPengLi <yampayne.lyp@alibaba-inc.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

7699258e

[VLM] Florence-2 supports online serving (#16164) · 7c803687
Isotr0py authored Apr 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
7c803687
[Bugfix] Make dummy encoder prompt padding alternative and add missing warnings (#16129) · fc0f8776
Isotr0py authored Apr 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
fc0f8776

06 Apr, 2025 3 commits
- [Model] use AutoWeightsLoader for stablelm,starcoder2,zamba2 (#16103) · 242a637a
  rongfu.leng authored Apr 06, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  242a637a
- [Model] fix model testing for TeleChat2ForCausalLM and V0 llama4 (#16112) · 620fc2d0
  Lucia Fang authored Apr 05, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  620fc2d0
- [Model] use AutoWeightsLoader for phi, gemma, deepseek (#16088) · 29283eaa
  Jonghyun Choe authored Apr 06, 2025
```
Signed-off-by: Jonghyun Choe <andy.choe729@gmail.com>
```
  29283eaa
04 Apr, 2025 3 commits
- Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
  Roger Wang authored Apr 04, 2025
  
  af51d80f
- [V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50
  Cyrus Leung authored Apr 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f5722a50
- [Model] use AutoWeightsLoader for baichuan, gpt-neox, mpt (#15939) · bf7e3c51
  Jonghyun Choe authored Apr 05, 2025
```
Signed-off-by: Jonghyun Choe <andy.choe729@gmail.com>
```
  bf7e3c51
03 Apr, 2025 2 commits
- [SupportsQuant] Chameleon, Chatglm, Commandr (#15952) · 82e7e19a
  Kyle Sayers authored Apr 03, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  82e7e19a
- [SupportsQuant] Bert, Blip, Blip2, Bloom (#15573) · 421c4629
  Kyle Sayers authored Apr 03, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  421c4629
02 Apr, 2025 2 commits
- [V1] Support Mistral3 in V1 (#15950) · f021b979
  Michael Goin authored Apr 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f021b979
- [Model] use AutoWeightsLoader in model load_weights (#15770) · e86c414d
  rongfu.leng authored Apr 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  e86c414d
01 Apr, 2025 7 commits

[Model][MiniMaxText01] Support MiniMaxText01 model inference (#13454) · 9ef98d52

Gerald authored Apr 02, 2025


Signed-off-by: qscqesze <475517977@qq.com>
Co-authored-by: qingjun <qingjun@minimaxi.com>
Co-authored-by: qscqesze <475517977@qq.com>

9ef98d52

[Model] Add module name prefixes to gemma3 (#15889) · 9ec82579

cloud11665 authored Apr 02, 2025


Signed-off-by: Bartholomew Sabat <bartek@recursal.ai>
Co-authored-by: Bartholomew Sabat <bartek@recursal.ai>

9ec82579

[Model] Aya Vision (#15441) · 38327cf4

Jennifer Zhao authored Apr 01, 2025


Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

38327cf4

[New Model]: jinaai/jina-reranker-v2-base-multilingual (#15876) · 085cbc4f

wang.yuqi authored Apr 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

085cbc4f

[Model] Support Mistral3 in the HF Transformers format (#15505) · 51d7c6a2

Michael Goin authored Apr 01, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

51d7c6a2

[Bugfix][Model] fix mllama multi-image (#14883) · ff647398
Yan Ma authored Apr 01, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
ff647398
Rename fallback model and refactor supported models section (#15829) · a76f547e
Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a76f547e

31 Mar, 2025 5 commits
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
- [Bugfix] Fix missing return value in load_weights method of adapters.py (#15542) · 037bcd94
  Mrm authored Mar 31, 2025
```
Signed-off-by: noc-turne <2270929247@qq.com>
```
  037bcd94
- [Bugfix] Fix Crashing When Loading Modules With Batchnorm Stats (#15813) · c2e7507a
  Alex Brooks authored Mar 31, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2e7507a
- [Model] Update support for NemotronNAS models (#15008) · 3aa2b6a6
  Naveassaf authored Mar 31, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  3aa2b6a6
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
30 Mar, 2025 4 commits
- fix: Comments to English for better dev experience (#15768) · 70fedd0f
  yihong authored Mar 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  70fedd0f
- [Bugfix] Added `embed_is_patch` mask for fuyu model (#15731) · bb103b29
  kYLe authored Mar 30, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
```
  bb103b29
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
29 Mar, 2025 1 commit
- [Bugfix] Fix Mllama interleaved images input support (#15564) · 3c0ff914
  Isotr0py authored Mar 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  3c0ff914