Commits · 760e3ecc8fa0cee06eff55fe08f91f621d4e2221 · OpenDAS / vllm_cscc

08 May, 2025 2 commits
- [Misc] Delete LoRA-related redundancy code (#17841) · a944f8ed
  Jee Jee Li authored May 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a944f8ed
- [Bugfix] `use_fast` failing to be propagated to Qwen2-VL image processor (#17838) · 015815fe
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  015815fe
07 May, 2025 4 commits
- [Kernel] Use fused rmsnorm for some models like qwen3 series (#17735) · f80ae5bd
  Wanrui Dai authored May 07, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  f80ae5bd
- [Misc] Use `apply_rotary_emb` from vllm_flash_attn for Qwen2-VL vision RoPE (#17726) · c3e9d506
  Isotr0py authored May 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c3e9d506
- [Misc] Split model loader (#17712) · 822de7fb
  Jee Jee Li authored May 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  822de7fb
- [Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for... · 18dd5e01
  Chih-Chieh Yang authored May 06, 2025
```
[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for Corresponding Kernels (#17146)
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  18dd5e01
06 May, 2025 1 commit

[Model] Add GraniteMoeHybrid 4.0 model (#17497) · 999328be

Stan Wozniak authored May 06, 2025


Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

999328be

04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
02 May, 2025 3 commits
- permute/unpermute kernel for moe optimization (#14568) · 3e887d2e
  Caleb_Du authored May 03, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  3e887d2e
- Fix PixtralHF missing spatial_merge_size (#17571) · f192ca90
  Michael Goin authored May 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f192ca90
- [Attention] MLA move o_proj q_proj into cuda-graph region (#17484) · afcb3f88
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  afcb3f88
01 May, 2025 5 commits
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE3 (#17504) · 39c0813a
  qizixi authored May 01, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  39c0813a
- Remove duplicate code from dbrx.py (#17550) · 04f2cfc8
  sstamenk authored May 01, 2025
  
  04f2cfc8
- [Model] Refactor Ovis2 to support original tokenizer (#17537) · 88c83041
  Isotr0py authored May 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  88c83041
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
- [Misc] Rename Audios -> Audio in Qwen2audio Processing (#17507) · 02bd6548
  Alex Brooks authored Apr 30, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  02bd6548
30 Apr, 2025 3 commits

[Fix] Support passing args to logger (#17425) · da4e7687
Aaron Pham authored Apr 30, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
da4e7687

[MODEL ADDITION] Ovis2 Model Addition (#15826) · 54072f31

Marco authored Apr 30, 2025


Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

54072f31

Support LoRA for Mistral3 (#17428) · a44c4f1d
Michael Goin authored Apr 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
a44c4f1d

29 Apr, 2025 9 commits
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
- Transformers backend tweaks (#17365) · 900edfa8
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  900edfa8
- [Bugfix] Clean up MiniMax-VL and fix processing (#17354) · 00ee37ef
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00ee37ef
- [Model] Ignore rotary embed load for Cohere model (#17319) · 97cc8729
  Ekagra Ranjan authored Apr 29, 2025
  
  97cc8729
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
- [Model] support MiniMax-VL-01 model (#16328) · cde384cd
  qscqesze authored Apr 29, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  cde384cd
- [model] make llama4 compatible with pure dense layers (#17315) · b4ac4fa0
  Lucia Fang authored Apr 28, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  b4ac4fa0
- [Optim] Compute multimodal hash only once per item (#17314) · 506475de
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  506475de
28 Apr, 2025 6 commits
- Support loading transformers models with named parameters (#16868) · 6e74fd49
  Alex Wu authored Apr 28, 2025
```
Signed-off-by: Alex <alexwu@character.ai>
```
  6e74fd49
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Bugfix] Add missing `get_language_model` to new MLLMs (#17300) · 344e193b
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  344e193b
- [Model] Add Granite Speech Support (#16246) · fa93cd9f
  Alex Brooks authored Apr 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  fa93cd9f
- [Minor][Models] Pass partial_rotary_factor parameter to rope (#17266) · 7fcc4223
  Wanrui Dai authored Apr 28, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  7fcc4223
- [Bugfix] Fix Mistral3 spatial merge error (#17270) · cb3f2d8d
  Michael Goin authored Apr 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cb3f2d8d
27 Apr, 2025 1 commit
- [Bugfix] Fix QWen2 VL multimodal mapping (#17240) · 4283a28c
  Jee Jee Li authored Apr 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4283a28c
26 Apr, 2025 2 commits
- [Minor][Models] Fix Return Types of Llama & Eagle (#17220) · b2789112
  Woosuk Kwon authored Apr 25, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b2789112
- [Bugfix] gemma[2,3] interleaved attention when sliding window is disabled (#17180) · 8de2901f
  Chen Zhang authored Apr 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8de2901f
25 Apr, 2025 2 commits

[V1][Spec Decode] EAGLE-3 Support (#16937) · a0e619e6

Benjamin Chislett authored Apr 25, 2025


Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Bryan Lu <yuzhelu@amazon.com>

a0e619e6

fix float16 support for kimi-vl (#17156) · 69bff9bc
Zaida Zhou authored Apr 25, 2025
```
Co-authored-by: zhouzaida <zhouzaida@msh.team>
```
69bff9bc

24 Apr, 2025 1 commit
- [Misc] Remove OLMo2 config copy (#17066) · b0c1f620
  Isotr0py authored Apr 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b0c1f620