Commits · c9c1b59e59a35d5004e3914e23015617fc330b31 · OpenDAS / vllm_cscc

"docs/guides/vscode:/vscode.git/clone" did not exist on "4000097653a9d6d345be96ff1466532a3a30f6f5"

29 Apr, 2025 8 commits
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
- Transformers backend tweaks (#17365) · 900edfa8
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  900edfa8
- [Bugfix] Clean up MiniMax-VL and fix processing (#17354) · 00ee37ef
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00ee37ef
- [Model] Ignore rotary embed load for Cohere model (#17319) · 97cc8729
  Ekagra Ranjan authored Apr 29, 2025
  
  97cc8729
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
- [Model] support MiniMax-VL-01 model (#16328) · cde384cd
  qscqesze authored Apr 29, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  cde384cd
- [model] make llama4 compatible with pure dense layers (#17315) · b4ac4fa0
  Lucia Fang authored Apr 28, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  b4ac4fa0
- [Optim] Compute multimodal hash only once per item (#17314) · 506475de
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  506475de
28 Apr, 2025 6 commits
- Support loading transformers models with named parameters (#16868) · 6e74fd49
  Alex Wu authored Apr 28, 2025
```
Signed-off-by: Alex <alexwu@character.ai>
```
  6e74fd49
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Bugfix] Add missing `get_language_model` to new MLLMs (#17300) · 344e193b
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  344e193b
- [Model] Add Granite Speech Support (#16246) · fa93cd9f
  Alex Brooks authored Apr 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  fa93cd9f
- [Minor][Models] Pass partial_rotary_factor parameter to rope (#17266) · 7fcc4223
  Wanrui Dai authored Apr 28, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  7fcc4223
- [Bugfix] Fix Mistral3 spatial merge error (#17270) · cb3f2d8d
  Michael Goin authored Apr 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cb3f2d8d
27 Apr, 2025 1 commit
- [Bugfix] Fix QWen2 VL multimodal mapping (#17240) · 4283a28c
  Jee Jee Li authored Apr 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4283a28c
26 Apr, 2025 2 commits
- [Minor][Models] Fix Return Types of Llama & Eagle (#17220) · b2789112
  Woosuk Kwon authored Apr 25, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b2789112
- [Bugfix] gemma[2,3] interleaved attention when sliding window is disabled (#17180) · 8de2901f
  Chen Zhang authored Apr 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8de2901f
25 Apr, 2025 2 commits

[V1][Spec Decode] EAGLE-3 Support (#16937) · a0e619e6

Benjamin Chislett authored Apr 25, 2025


Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Bryan Lu <yuzhelu@amazon.com>

a0e619e6

fix float16 support for kimi-vl (#17156) · 69bff9bc
Zaida Zhou authored Apr 25, 2025
```
Co-authored-by: zhouzaida <zhouzaida@msh.team>
```
69bff9bc

24 Apr, 2025 3 commits
- [Misc] Remove OLMo2 config copy (#17066) · b0c1f620
  Isotr0py authored Apr 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b0c1f620
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
- [Quantization]add prefix for commandA quantized model (#17017) · 6b2427f9
  Chen Xia authored Apr 23, 2025
  
  6b2427f9
22 Apr, 2025 2 commits
- [Bugfix] Fix distributed bug again in Qwen2.5-VL & Qwen2.5-Omni (#16974) · 571e8dd6
  Yang Fan authored Apr 22, 2025
```
Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
```
  571e8dd6
- [Model] Use autoweightloader for mamba (#16950) · 2689d5c0
  Flora Feng authored Apr 22, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  2689d5c0
21 Apr, 2025 2 commits
- [Bugfix] Fix GLM rotary_dim issue and support v1 (#16912) · 55d6d3fd
  Isotr0py authored Apr 21, 2025
```
Signed-off-by: isotr0py <2037008807@qq.com>
```
  55d6d3fd
- [Bugfix] Fix distributed bug in Qwen2.5-VL & Qwen2.5-Omni (#16907) · 26c04065
  Yang Fan authored Apr 21, 2025
  
  26c04065
19 Apr, 2025 4 commits

[VLM] Clean up models (#16873) · 205d84aa
Cyrus Leung authored Apr 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
205d84aa
[Model] Qwen2.5-Omni Cleanup (#16872) · 5124f5bf
Roger Wang authored Apr 19, 2025

5124f5bf

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) · 83f3c3bd

Isotr0py authored Apr 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

83f3c3bd

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) · 2c1bd848

Yang Fan authored Apr 19, 2025


Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>

2c1bd848

18 Apr, 2025 5 commits
- [New Model]: Snowflake Arctic Embed (Family) (#16649) · 3d3ab368
  wang.yuqi authored Apr 18, 2025
  
  3d3ab368
- [Misc] Clean up Kimi-VL (#16833) · aadb6565
  Cyrus Leung authored Apr 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aadb6565
- [Model] use AutoWeightsLoader for BigCode, GPT-J (#16823) · 87e067de
  Jonghyun Choe authored Apr 18, 2025
```
Signed-off-by: Jonghyun Choe <andy.choe729@gmail.com>
```
  87e067de
- [Bugfix] fix pp for llama4 (#16746) · e31045f9
  Lucia Fang authored Apr 17, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  e31045f9
- [BugFix] Accuracy fix for llama4 int4 - improperly casted scales (#16801) · 7eb42556
  Lucas Wilkinson authored Apr 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  7eb42556
17 Apr, 2025 2 commits
- [Model] use AutoWeightsLoader for olmoe,opt,orion,persimmon,phi3_small (#16548) · 5125d72f
  rongfu.leng authored Apr 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  5125d72f
- [Bugfix] Fix GLM4 model (#16618) · 5b1aca2a
  intervitens authored Apr 17, 2025
```
Signed-off-by: intervitens <intervitens@tutanota.com>
```
  5b1aca2a
16 Apr, 2025 2 commits

[Model] support modernbert (#16648) · ee378f3d

xsank authored Apr 16, 2025


Signed-off-by: 唯勤 <xsank.mz@alibaba-inc.com>
Co-authored-by: 唯勤 <xsank.mz@alibaba-inc.com>

ee378f3d

[Model] Add PLaMo2 (#14323) · 3badb021

Shinichi Hemmi authored Apr 16, 2025


Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Signed-off-by: shemmi <shemmi@preferred.jp>
Co-authored-by: Kento Nozawa <nzw0301@preferred.jp>
Co-authored-by: Hiroaki Mikami <mhiroaki@preferred.jp>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>

3badb021

15 Apr, 2025 1 commit
- [Bugfix] Fix broken GritLM model and tests (missing pooling_metadata) (#16631) · bc5dd4f6
  Pooya Davoodi authored Apr 14, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  bc5dd4f6