Commits · 05fb6718f0d80519fcb8011ccd841fc7f37db3c1 · OpenDAS / vllm_cscc

"cmake/vscode:/vscode.git/clone" did not exist on "cb3935a8fc1968cdd2d7fa2dfd963900419820a0"

07 Mar, 2025 3 commits
- [Bugfix] Clean up multi-modal processors (#14417) · 05fb6718
  Cyrus Leung authored Mar 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  05fb6718
- [FP8] Refactor apply_fp8_linear and apply_fp8_linear_generic into an object (#14390) · e1744502
  Luka Govedič authored Mar 07, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  e1744502
- [Perf] Reduce MLA CPU overheads in V1 (#14384) · dae68969
  Lucas Wilkinson authored Mar 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  dae68969
06 Mar, 2025 6 commits
- [Bugfix] Fix use_direct_call condition in FusedMoE layer for (#14382) · 958adce4
  Tyler Michael Smith authored Mar 06, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  958adce4
- [Distributed] Add enable_expert_parallel arg (#14305) · cc2f9b32
  Tyler Michael Smith authored Mar 06, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  cc2f9b32
- [Core] Optimizing cross-attention `QKVParallelLinear` computation (#12325) · 69ff99fd
  Nicolò Lucchesi authored Mar 06, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>
Co-authored-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>
```
  69ff99fd
- [V1][VLM][Pixtral-HF] Support Pixtral-HF on V1 (#14275) · 5d802522
  lkchen authored Mar 06, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  5d802522
- [Model] Update Paligemma multimodal processing with PromptUpdate (#14015) · 17699280
  kYLe authored Mar 06, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  17699280
- [Bugfix][Structured Output] Support outlines engine with reasoning outputs for DeepSeek R1 (#14114) · f5f7f00c
  Ce Gao authored Mar 06, 2025
  
  f5f7f00c
05 Mar, 2025 5 commits
- [LoRA] Remove linear hack outside transformers backend (#14177) · e17e4488
  Isotr0py authored Mar 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e17e4488
- [Misc][V1] Avoid using `envs.VLLM_USE_V1` in mm processing (#14256) · ec79b67c
  Roger Wang authored Mar 04, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  ec79b67c
- [V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
  Tyler Michael Smith authored Mar 05, 2025
  
  72c62eae
- [Model] New model support for Phi-4-multimodal-instruct (#14119) · 0a995d54
  Congcong Chen authored Mar 04, 2025
  
  0a995d54
- [Bugfix] Fix gptq_marlin for deepseek-v3 (#13750) · 0df25101
  rainkert authored Mar 05, 2025
```
Signed-off-by: dangshunya <dangshunya@baichuan-inc.com>
Co-authored-by: dangshunya <dangshunya@baichuan-inc.com>
```
  0df25101
04 Mar, 2025 4 commits
- Clean up unused padding_idx variables across many model definitions (#13240) · 4f5b059f
  Tyler Michael Smith authored Mar 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  4f5b059f
- [V1][Molmo] Fix get_multimodal_embeddings() in molmo.py (#14161) · b3cf368d
  lkchen authored Mar 04, 2025
  
  b3cf368d
- [core] moe fp8 block quant tuning support (#14068) · bb5b6403
  Divakar Verma authored Mar 03, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  bb5b6403
- [Model] Add support for GraniteMoeShared models (#13313) · c060b714
  Travis Johnson authored Mar 03, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  c060b714
03 Mar, 2025 5 commits
- [Kernel] Optimize moe intermediate_cache usage (#13625) · 19d98e0c
  Michael Goin authored Mar 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  19d98e0c
- [Bugfix] Allow shared_experts skip quantization for DeepSeekV2/V3 (#14100) · 2b04c209
  Michael Goin authored Mar 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  2b04c209
- Fix `head_dim` not existing in all model configs (Transformers backend) (#14141) · 91373a0d
  Harry Mellor authored Mar 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  91373a0d
- [Misc][Platform] Move use allgather to platform (#14010) · b87c21fc
  Mengqing Cao authored Mar 03, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  b87c21fc
- [Misc] duplicate code in deepseek_v2 (#14106) · e584b85a
  wang.yuqi authored Mar 03, 2025
  
  e584b85a
02 Mar, 2025 3 commits
- [v0][structured output] Support reasoning output (#12955) · bf33700e
  Ce Gao authored Mar 03, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  bf33700e
- [Misc] Accurately capture the time of loading weights (#14063) · 82fbeae9
  Jun Duan authored Mar 01, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  82fbeae9
- [Model] Add LoRA support for TransformersModel (#13770) · cc5e8f6d
  Jee Jee Li authored Mar 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cc5e8f6d
01 Mar, 2025 3 commits
- [Doc] Consolidate `whisper` and `florence2` examples (#14050) · fdcc4053
  Isotr0py authored Mar 01, 2025
  
  fdcc4053
- [Misc][Kernel]: Add GPTQAllSpark Quantization (#12931) · 6a92ff93
  YajieWang authored Mar 01, 2025
  
  6a92ff93
- [Bugfix] Add file lock for ModelScope download (#14060) · 6a84164a
  Jee Jee Li authored Mar 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6a84164a
28 Feb, 2025 7 commits
- [torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename... · bd56c983
  Luka Govedič authored Feb 28, 2025
```
[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)
Signed-off-by: luka <luka@neuralmagic.com>
```
  bd56c983
- [Bugfix] Initialize attention bias on the same device as Query/Key/Value for QwenVL Series (#14031) · 9b61dd41
  Yang Liu authored Feb 28, 2025
  
  9b61dd41
- [VLM][Bugfix] Enable specifying prompt target via index (#14038) · f7bee5c8
  Cyrus Leung authored Feb 28, 2025
  
  f7bee5c8
- [Bugfix] Fix MoeWNA16Method activation (#14024) · e0734387
  Jee Jee Li authored Feb 28, 2025
  
  e0734387
- [Doc] Move multimodal Embedding API example to Online Serving page (#14017) · 1088f062
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1088f062
- [Bugfix] Check that number of images matches number of <|image|> tokens with mllama (#13911) · 73e0225e
  Travis Johnson authored Feb 27, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  73e0225e
- [V1]`SupportsV0Only` protocol for model definitions (#13959) · 6c85da3a
  Roger Wang authored Feb 27, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  6c85da3a
27 Feb, 2025 4 commits
- [Misc] Print FusedMoE detail info (#13974) · 67fc4268
  Jee Jee Li authored Feb 28, 2025
  
  67fc4268
- [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626) · 9804145c
  Benjamin Chislett authored Feb 27, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  9804145c
- [core] Perf improvement for DSv3 on AMD GPUs (#13718) · 8294773e
  qli88 authored Feb 27, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
  8294773e
- [Attention] MLA support for V1 (#13789) · 58d1b2aa
  Yang Chen authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  58d1b2aa