Commits · f2ebb6f541ab6afa30907232df6883319a0a4d83 · OpenDAS / vllm_cscc

08 Apr, 2025 2 commits

[V1] Scatter and gather placeholders in the model runner (#16076) · f2ebb6f5

Roger Wang authored Apr 07, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>

f2ebb6f5

[ROCm][Bugfix][FP8] Make fp8 quant respect fused modules mapping (#16031) · 21802c4b
Michael Goin authored Apr 07, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
21802c4b

07 Apr, 2025 8 commits

Torchao (#14231) · 652907b3
Driss Guessous authored Apr 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
652907b3
[Bugfix][V0] XGrammar structured output supports Enum (#15878) · 24f1c01e
leon-seidel authored Apr 08, 2025
```
Signed-off-by: Leon Seidel <leon.seidel@fau.de>
```
24f1c01e
[Misc] Move Llama 4 projector call into encoder execution (#16201) · ed636d99
Roger Wang authored Apr 07, 2025

ed636d99
[Bugfix] Re-enable support for `ChatGLMForConditionalGeneration` (#16187) · 027b204f
Cyrus Leung authored Apr 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
027b204f

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

55dcce91

[Model] Add Qwen3 and Qwen3MoE (#15289) · 7699258e

YamPengLi authored Apr 07, 2025


Signed-off-by: YamPengLi <yampayne.lyp@alibaba-inc.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

7699258e

[VLM] Florence-2 supports online serving (#16164) · 7c803687
Isotr0py authored Apr 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
7c803687
[Bugfix] Make dummy encoder prompt padding alternative and add missing warnings (#16129) · fc0f8776
Isotr0py authored Apr 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
fc0f8776

06 Apr, 2025 4 commits
- [Model] use AutoWeightsLoader for stablelm,starcoder2,zamba2 (#16103) · 242a637a
  rongfu.leng authored Apr 06, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  242a637a
- [Model] fix model testing for TeleChat2ForCausalLM and V0 llama4 (#16112) · 620fc2d0
  Lucia Fang authored Apr 05, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  620fc2d0
- [Model] use AutoWeightsLoader for phi, gemma, deepseek (#16088) · 29283eaa
  Jonghyun Choe authored Apr 06, 2025
```
Signed-off-by: Jonghyun Choe <andy.choe729@gmail.com>
```
  29283eaa
- [Bugfix] fix use_atomic_add support of marlin kernel when using v1 engine (#15946) · 2fa66ef7
  Jinzhen Lin authored Apr 06, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  2fa66ef7
04 Apr, 2025 5 commits
- [Kernel][Minor] Re-fuse triton moe weight application (#16071) · d6fc629f
  bnellnm authored Apr 04, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  d6fc629f
- Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
  Roger Wang authored Apr 04, 2025
  
  af51d80f
- [V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50
  Cyrus Leung authored Apr 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f5722a50
- [Hardware][Gaudi][BugFix] fix arguments of hpu fused moe (#15945) · 0812d8dd
  liuzhenwei authored Apr 05, 2025
```
Signed-off-by: zhenwei <zhenweiliu@habana.ai>
```
  0812d8dd
- [Model] use AutoWeightsLoader for baichuan, gpt-neox, mpt (#15939) · bf7e3c51
  Jonghyun Choe authored Apr 05, 2025
```
Signed-off-by: Jonghyun Choe <andy.choe729@gmail.com>
```
  bf7e3c51
03 Apr, 2025 3 commits
- [Minor] Fused experts refactor (#15914) · 15ba07ef
  bnellnm authored Apr 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  15ba07ef
- [SupportsQuant] Chameleon, Chatglm, Commandr (#15952) · 82e7e19a
  Kyle Sayers authored Apr 03, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  82e7e19a
- [SupportsQuant] Bert, Blip, Blip2, Bloom (#15573) · 421c4629
  Kyle Sayers authored Apr 03, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  421c4629
02 Apr, 2025 6 commits
- [V1] Support Mistral3 in V1 (#15950) · f021b979
  Michael Goin authored Apr 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f021b979
- [Model] use AutoWeightsLoader in model load_weights (#15770) · e86c414d
  rongfu.leng authored Apr 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  e86c414d
- [V1] Fix json_object support with xgrammar (#15488) · 14e53ed1
  Russell Bryant authored Apr 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  14e53ed1
- [Kernel] Add more dtype support for GGUF dequantization (#15879) · 90969fb3
  LukasBluebaum authored Apr 02, 2025
```
Signed-off-by: lukas.bluebaum <lukas.bluebaum@aleph-alpha.com>
```
  90969fb3
- [V1][Bugfix] Fix typo in MoE TPU checking (#15927) · 0e00d40e
  Roger Wang authored Apr 01, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0e00d40e
- [Bugfix] Fix imports for MoE on CPU (#15841) · 2039c630
  Thien Tran authored Apr 02, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  2039c630
01 Apr, 2025 11 commits
- [Model][MiniMaxText01] Support MiniMaxText01 model inference (#13454) · 9ef98d52
  Gerald authored Apr 02, 2025
```
Signed-off-by: qscqesze <475517977@qq.com>
Co-authored-by: qingjun <qingjun@minimaxi.com>
Co-authored-by: qscqesze <475517977@qq.com>
```
  9ef98d52
- [Model] Add module name prefixes to gemma3 (#15889) · 9ec82579
  cloud11665 authored Apr 02, 2025
```
Signed-off-by: Bartholomew Sabat <bartek@recursal.ai>
Co-authored-by: Bartholomew Sabat <bartek@recursal.ai>
```
  9ec82579
- [Model] Aya Vision (#15441) · 38327cf4
  Jennifer Zhao authored Apr 01, 2025
```
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  38327cf4
- Add option to use DeepGemm contiguous grouped gemm kernel for fused MoE operations. (#13932) · e59ca942
  bnellnm authored Apr 01, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e59ca942
- [New Model]: jinaai/jina-reranker-v2-base-multilingual (#15876) · 085cbc4f
  wang.yuqi authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  085cbc4f
- [Model] Support Mistral3 in the HF Transformers format (#15505) · 51d7c6a2
  Michael Goin authored Apr 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  51d7c6a2
- [V1] TPU - Fix fused MOE (#15834) · 7e4e709b
  Alexander Matveev authored Apr 01, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  7e4e709b
- [Bugfix]: Fix is_embedding_layer condition in VocabParallelEmbedding (#15824) · 63d8eabe
  Alexey Kiryushin authored Apr 01, 2025
```
Signed-off-by: alexwl <alexey.a.kiryushin@gmail.com>
```
  63d8eabe
- [Bugfix] Fix extra comma (#15851) · e830b013
  Percy authored Apr 01, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  e830b013
- [Bugfix][Model] fix mllama multi-image (#14883) · ff647398
  Yan Ma authored Apr 01, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  ff647398
- Rename fallback model and refactor supported models section (#15829) · a76f547e
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a76f547e
31 Mar, 2025 1 commit
- Fix Transformers backend compatibility check (#15290) · d4bfc23e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4bfc23e