Commits · 5eeadc264246d8d8b95012350bde14b1cc431147 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "6dec9f61098786690b4ca2140682dbafb849f8d9"

24 Mar, 2025 5 commits
- [Hardware][Gaudi][Feature] Enable Dynamic MoE for Mixtral (#12303) · 5eeadc26
  liuzhenwei authored Mar 25, 2025
```
Signed-off-by: zhenwei <zhenweiliu@habana.ai>
```
  5eeadc26
- [Core] Integrate `fastsafetensors` loader for loading model weights (#10647) · 761702fd
  Manish Sethi authored Mar 24, 2025
```
Signed-off-by: Manish Sethi <Manish.sethi1@ibm.com>
```
  761702fd
- [Bugfix][V1] Avoid importing PreTrainedModel (#15366) · 948ab03e
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Mar 24, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  948ab03e
- [Misc] Upgrade BNB version (#15183) · 3892e58a
  Jee Jee Li authored Mar 24, 2025
  
  3892e58a
- Fix non-contiguous input passed to Marlin kernel (#15319) · d20e2611
  Qubitium-ModelCloud authored Mar 24, 2025
  
  d20e2611
23 Mar, 2025 1 commit
- [Misc] Add tuned R1 w8a8 and MoE configs for NVIDIA L20 (#15322) · f90d34b4
  DefTruth authored Mar 23, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  f90d34b4
22 Mar, 2025 3 commits

Remove openvino support in favor of external plugin (#15339) · b877031d
Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
b877031d

[Model] Support Tele-FLM Model (#15023) · 2f4bd358

Naitong Yu authored Mar 22, 2025


Signed-off-by: Naitong Yu <ntyu@baai.ac.cn>
Signed-off-by: jiangxin <horizon94@outlook.com>
Co-authored-by: Jason Fang <jasonfang3900@gmail.com>
Co-authored-by: jiangxin <horizon94@outlook.com>

2f4bd358

[FEAT] [ROCm]: Add AITER RMS Norm (Layer Norm) Feature (#14959) · ec870fba
TJian authored Mar 22, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
ec870fba

21 Mar, 2025 6 commits
- [Bugfix][VLM] fix llava processor (#15285) · c21b99b9
  Mengqing Cao authored Mar 21, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  c21b99b9
- [Bugfix] Fix incorrect resolving order for transformers fallback (#15279) · 84e00adc
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  84e00adc
- [Misc] Add attention mask pre-computation optimization back to Qwen2.5-VL (#15273) · 47c71262
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  47c71262
- [Model] RE: Mamba2 Prefill Performance Tweaks: Fixing Flurry of Unnecessary Memory Copies (#14857) · 296f927f
  Chih-Chieh Yang authored Mar 20, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  296f927f
- [Bugfix] Fix incorrect qwen2.5-vl attention mask pre-computation (#15200) · 1e508343
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1e508343
- Enforce that TP > 1 is not supported for Mamba2 if Quantization is Enabled. (#14617) · 06dd0825
  Yu Chin Fabian Lim authored Mar 21, 2025
```
Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  06dd0825
20 Mar, 2025 6 commits
- [Bugfix] Multi-video inference on LLaVA-Onevision (#15082) · 27261e40
  Cyrus Leung authored Mar 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  27261e40
- [Frontend][Bugfix] support prefill decode disaggregation on deepseek (#14824) · 742369d3
  billishyahao authored Mar 20, 2025
```
Signed-off-by: billishyahao <bill.he@amd.com>
Co-authored-by: Zhai Feiyue <80079571+ZhaiFeiyue@users.noreply.github.com>
```
  742369d3
- Enable CUDA graph support for llama 3.2 vision (#14917) · a8652f4f
  Matt Ritter authored Mar 19, 2025
```
Signed-off-by: Matt Ritter <100659061+mritterfigma@users.noreply.github.com>
```
  a8652f4f
- [Attention] Flash Attention 3 - fp8 (#14570) · a597a575
  Mickaël Seznec authored Mar 20, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  a597a575
- [Core][V0] Add guidance backend for structured output (#14589) · 1f16b7fe
  Russell Bryant authored Mar 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <lohuynh@microsoft.com>
Co-authored-by: Michal Moskal <michal@moskal.me>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  1f16b7fe
- [Bugfix] Fix embedding assignment for InternVL-based models (#15086) · ffa443af
  Cyrus Leung authored Mar 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ffa443af
19 Mar, 2025 3 commits
- [Bugfix] Adjust mllama to regional compilation (#15112) · 8363cd09
  Jan Kaniecki authored Mar 19, 2025
```
Signed-off-by: Jan Kaniecki <jkaniecki@habana.ai>
```
  8363cd09
- [Bugfix] Re-enable Gemma3 for V1 (#14980) · 61f41218
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61f41218
- [Model] Pixtral: Remove layer instantiation duplication (#15053) · 437f9162
  Julien Denize authored Mar 19, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  437f9162
18 Mar, 2025 4 commits

[Bugfix] Fix broken CPU quantization due to triton import (#15038) · 179a619c
Isotr0py authored Mar 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
179a619c

[MODEL] Add support for Zamba2 models (#13185) · 452e8fd9

yury-tokpanov authored Mar 18, 2025


Signed-off-by: Yury Tokpanov <yury@zyphra.com>
Signed-off-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

452e8fd9

MI325 configs, fused_moe_kernel bugfix (#14987) · 8b793f7e
ekuznetsov139 authored Mar 18, 2025
```
Signed-off-by: Eugene Kuznetsov <eugene.kuznetsov@amd.com>
```
8b793f7e
[Bugfix] Loosen type check to avoid errors in V1 (#15021) · ab656f2c
Cyrus Leung authored Mar 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ab656f2c

17 Mar, 2025 8 commits
- [Bugfix] Fix bnb quantization for models with both HF-format and Mistral-format weights (#14950) · 5eeabc2a
  Tristan Leclercq authored Mar 18, 2025
  
  5eeabc2a
- [Bugfix] Fix interface for Olmo2 on V1 (#14976) · 5340b0e2
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  5340b0e2
- [Bugfix] Make Gemma3 MM V0 only for now (#14971) · 37e38061
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  37e38061
- [Fix][Structured Output] using vocab_size to construct matcher (#14868) · c0efdd65
  Aaron Pham authored Mar 17, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  c0efdd65
- [Bugfix][Model] Mixtral: use unused head_dim config argument (#14961) · aaaec52a
  Quentin authored Mar 17, 2025
```
Signed-off-by: Quentin Torroba <quentin.torroba@mistral.ai>
```
  aaaec52a
- [Bugfix] Fix precommit - line too long in pixtral.py (#14960) · e1eb45d3
  Tyler Michael Smith authored Mar 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e1eb45d3
- Add patch merger (#14957) · d20b0c13
  Patrick von Platen authored Mar 17, 2025
  
  d20b0c13
- [Bugfix] Fix Ultravox on V1 (#14929) · 868a8c5b
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  868a8c5b
16 Mar, 2025 3 commits
- [Bugfix] Explicitly disable Phi-4-multimodal in V1 (#14889) · e53b1350
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e53b1350
- [Kernel] Add more tuned configs (#14877) · 71c1e071
  Simon Mo authored Mar 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  71c1e071
- [VLM] Clean up Phi-4-MM ViT implementation (#14812) · def232e1
  Isotr0py authored Mar 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  def232e1
15 Mar, 2025 1 commit

[VLM] Merged multi-modal processor for Pixtral (#12211) · 61c6a5a7

Rémi Delacourt authored Mar 15, 2025


Signed-off-by: remi <remi@mistral.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

61c6a5a7