Commits · 83f74c698f1f7c781ae02e3c533a52432799e717 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "df04dffade84c87cafd74de4c39e6fd7cb95c24f"

14 May, 2025 5 commits
- Modularize fused experts and integrate PPLX kernels (#15956) · f9c069c8
  bnellnm authored May 14, 2025
  
  f9c069c8
- [V1][Spec Decode] Share input embedding of target model with EAGLE draft model... · 418d2f8b
  Ekagra Ranjan authored May 14, 2025
```
[V1][Spec Decode] Share input embedding of target model with EAGLE draft model to free ~1GB for llama 3 model (#17326)
Co-authored-by: root <root@ekagra-8xh100.us-east5-a.c.serving-efficiency-poc.internal>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  418d2f8b
- [Model] GritLM supports other attention backends (#18109) · d62a076e
  Cyrus Leung authored May 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d62a076e
- [Model] Add packed_modules_mapping for Qwen3-MOE (#18118) · 63dc3426
  Jee Jee Li authored May 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  63dc3426
- [New Model]: support GTE NewModel (#17986) · 63ad6222
  wang.yuqi authored May 14, 2025
  
  63ad6222
13 May, 2025 1 commit
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
12 May, 2025 2 commits
- [Model] Support MiMo-7B inference with MTP (#17433) · acee8f48
  bwshen-mi authored May 13, 2025
```
Signed-off-by: wp-alpha <wangpeng66@xiaomi.com>
Co-authored-by: wangpeng66 <wangpeng66@xiaomi.com>
```
  acee8f48
- [Model] Broadcast Ovis2 implementation to fit Ovis1.6 (#17861) · 021c16c7
  Isotr0py authored May 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  021c16c7
11 May, 2025 1 commit
- [New Model]: nomic-embed-text-v2-moe (#17785) · e4b87133
  wang.yuqi authored May 11, 2025
  
  e4b87133
09 May, 2025 1 commit
- [Attention] MLA move rotary embedding to cuda-graph region (#17668) · 5e6f9394
  Lucas Wilkinson authored May 08, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  5e6f9394
08 May, 2025 2 commits
- [Misc] Delete LoRA-related redundancy code (#17841) · a944f8ed
  Jee Jee Li authored May 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a944f8ed
- [Bugfix] `use_fast` failing to be propagated to Qwen2-VL image processor (#17838) · 015815fe
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  015815fe
07 May, 2025 4 commits
- [Kernel] Use fused rmsnorm for some models like qwen3 series (#17735) · f80ae5bd
  Wanrui Dai authored May 07, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  f80ae5bd
- [Misc] Use `apply_rotary_emb` from vllm_flash_attn for Qwen2-VL vision RoPE (#17726) · c3e9d506
  Isotr0py authored May 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c3e9d506
- [Misc] Split model loader (#17712) · 822de7fb
  Jee Jee Li authored May 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  822de7fb
- [Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for... · 18dd5e01
  Chih-Chieh Yang authored May 06, 2025
```
[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for Corresponding Kernels (#17146)
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  18dd5e01
06 May, 2025 1 commit

[Model] Add GraniteMoeHybrid 4.0 model (#17497) · 999328be

Stan Wozniak authored May 06, 2025


Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

999328be

04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
02 May, 2025 3 commits
- permute/unpermute kernel for moe optimization (#14568) · 3e887d2e
  Caleb_Du authored May 03, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  3e887d2e
- Fix PixtralHF missing spatial_merge_size (#17571) · f192ca90
  Michael Goin authored May 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f192ca90
- [Attention] MLA move o_proj q_proj into cuda-graph region (#17484) · afcb3f88
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  afcb3f88
01 May, 2025 5 commits
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE3 (#17504) · 39c0813a
  qizixi authored May 01, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  39c0813a
- Remove duplicate code from dbrx.py (#17550) · 04f2cfc8
  sstamenk authored May 01, 2025
  
  04f2cfc8
- [Model] Refactor Ovis2 to support original tokenizer (#17537) · 88c83041
  Isotr0py authored May 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  88c83041
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
- [Misc] Rename Audios -> Audio in Qwen2audio Processing (#17507) · 02bd6548
  Alex Brooks authored Apr 30, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  02bd6548
30 Apr, 2025 3 commits

[Fix] Support passing args to logger (#17425) · da4e7687
Aaron Pham authored Apr 30, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
da4e7687

[MODEL ADDITION] Ovis2 Model Addition (#15826) · 54072f31

Marco authored Apr 30, 2025


Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

54072f31

Support LoRA for Mistral3 (#17428) · a44c4f1d
Michael Goin authored Apr 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
a44c4f1d

29 Apr, 2025 9 commits
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
- Transformers backend tweaks (#17365) · 900edfa8
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  900edfa8
- [Bugfix] Clean up MiniMax-VL and fix processing (#17354) · 00ee37ef
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00ee37ef
- [Model] Ignore rotary embed load for Cohere model (#17319) · 97cc8729
  Ekagra Ranjan authored Apr 29, 2025
  
  97cc8729
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
- [Model] support MiniMax-VL-01 model (#16328) · cde384cd
  qscqesze authored Apr 29, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  cde384cd
- [model] make llama4 compatible with pure dense layers (#17315) · b4ac4fa0
  Lucia Fang authored Apr 28, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  b4ac4fa0
- [Optim] Compute multimodal hash only once per item (#17314) · 506475de
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  506475de
28 Apr, 2025 2 commits
- Support loading transformers models with named parameters (#16868) · 6e74fd49
  Alex Wu authored Apr 28, 2025
```
Signed-off-by: Alex <alexwu@character.ai>
```
  6e74fd49
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96