Commits · 322a0be6ba963f8f376f00a5daa55848de0ea596 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "58170d65034f7a89edc56c716f1fcf05ff336aa5"

19 Mar, 2025 3 commits
- [Bugfix] Adjust mllama to regional compilation (#15112) · 8363cd09
  Jan Kaniecki authored Mar 19, 2025
```
Signed-off-by: Jan Kaniecki <jkaniecki@habana.ai>
```
  8363cd09
- [Bugfix] Re-enable Gemma3 for V1 (#14980) · 61f41218
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61f41218
- [Model] Pixtral: Remove layer instantiation duplication (#15053) · 437f9162
  Julien Denize authored Mar 19, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  437f9162
18 Mar, 2025 7 commits

[Bugfix] Fix broken CPU quantization due to triton import (#15038) · 1a504aff
Isotr0py authored Mar 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
1a504aff

[MODEL] Add support for Zamba2 models (#13185) · 01ca85bb

yury-tokpanov authored Mar 18, 2025


Signed-off-by: Yury Tokpanov <yury@zyphra.com>
Signed-off-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01ca85bb

[Bugfix] Loosen type check to avoid errors in V1 (#15021) · be13281d
Cyrus Leung authored Mar 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
be13281d
[Bugfix] Fix broken CPU quantization due to triton import (#15038) · 179a619c
Isotr0py authored Mar 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
179a619c

[MODEL] Add support for Zamba2 models (#13185) · 452e8fd9

yury-tokpanov authored Mar 18, 2025


Signed-off-by: Yury Tokpanov <yury@zyphra.com>
Signed-off-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

452e8fd9

MI325 configs, fused_moe_kernel bugfix (#14987) · 8b793f7e
ekuznetsov139 authored Mar 18, 2025
```
Signed-off-by: Eugene Kuznetsov <eugene.kuznetsov@amd.com>
```
8b793f7e
[Bugfix] Loosen type check to avoid errors in V1 (#15021) · ab656f2c
Cyrus Leung authored Mar 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ab656f2c

17 Mar, 2025 9 commits
- [Bugfix] Fix bnb quantization for models with both HF-format and Mistral-format weights (#14950) · 5eeabc2a
  Tristan Leclercq authored Mar 18, 2025
  
  5eeabc2a
- [Bugfix] Fix interface for Olmo2 on V1 (#14976) · 5ac1a8e6
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  5ac1a8e6
- [Bugfix] Fix interface for Olmo2 on V1 (#14976) · 5340b0e2
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  5340b0e2
- [Bugfix] Make Gemma3 MM V0 only for now (#14971) · 37e38061
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  37e38061
- [Fix][Structured Output] using vocab_size to construct matcher (#14868) · c0efdd65
  Aaron Pham authored Mar 17, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  c0efdd65
- [Bugfix][Model] Mixtral: use unused head_dim config argument (#14961) · aaaec52a
  Quentin authored Mar 17, 2025
```
Signed-off-by: Quentin Torroba <quentin.torroba@mistral.ai>
```
  aaaec52a
- [Bugfix] Fix precommit - line too long in pixtral.py (#14960) · e1eb45d3
  Tyler Michael Smith authored Mar 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e1eb45d3
- Add patch merger (#14957) · d20b0c13
  Patrick von Platen authored Mar 17, 2025
  
  d20b0c13
- [Bugfix] Fix Ultravox on V1 (#14929) · 868a8c5b
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  868a8c5b
16 Mar, 2025 3 commits
- [Bugfix] Explicitly disable Phi-4-multimodal in V1 (#14889) · e53b1350
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e53b1350
- [Kernel] Add more tuned configs (#14877) · 71c1e071
  Simon Mo authored Mar 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  71c1e071
- [VLM] Clean up Phi-4-MM ViT implementation (#14812) · def232e1
  Isotr0py authored Mar 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  def232e1
15 Mar, 2025 7 commits
- [VLM] Merged multi-modal processor for Pixtral (#12211) · 61c6a5a7
  Rémi Delacourt authored Mar 15, 2025
```
Signed-off-by: remi <remi@mistral.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61c6a5a7
- [VLM] Limit multimodal input cache by memory (#14805) · 3556a414
  Cyrus Leung authored Mar 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3556a414
- [Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
  Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  9ed6ee92
- [V1] V1 Enablement Oracle (#13726) · d4d93db2
  Robert Shaw authored Mar 15, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  d4d93db2
- [Misc] Remove misleading message in gemma2 and gemma3 (#14850) · 97ac781c
  Isotr0py authored Mar 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  97ac781c
- Disable outlines cache by default (#14837) · 776dcec8
  Russell Bryant authored Mar 14, 2025
  
  776dcec8
- Revert "[Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of U… (#14848) · ccf02fcb
  Tyler Michael Smith authored Mar 14, 2025
  
  ccf02fcb
14 Mar, 2025 6 commits
- [Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of Unnecessary Memory Copies (#14778) · fe66b347
  Chih-Chieh Yang authored Mar 14, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  fe66b347
- [VLM] Various cleanup and fixes (#14806) · ab93f136
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ab93f136
- [Misc] Gemma3ForConditionalGeneration supports LoRA (#14797) · 989ecd20
  Jee Jee Li authored Mar 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  989ecd20
- [Misc] Clean up type annotation for `SupportsMultiModal` (#14794) · 601bd326
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  601bd326
- [Attention] MLA get rid of materialization (#14770) · 9532c498
  Lucas Wilkinson authored Mar 14, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  9532c498
- [Bugfix][IPEX] Add `VLLM_CPU_MOE_PREPACK` to allow disabling MoE prepack when... · 95d680b8
  Thien Tran authored Mar 14, 2025
```
[Bugfix][IPEX] Add `VLLM_CPU_MOE_PREPACK` to allow disabling MoE prepack when CPU does not support it (#14681)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  95d680b8
13 Mar, 2025 5 commits
- [Attention] Remove slow setattr in MLA (#14769) · d47807ba
  Lucas Wilkinson authored Mar 13, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d47807ba
- [Bugfix] Fix prompt format of GLM4V (#14539) · f53a0586
  Cyrus Leung authored Mar 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f53a0586
- [VLM] Support loading InternVideo2.5 models as original InternVLChatModel (#14738) · b1cc4dfe
  Isotr0py authored Mar 13, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b1cc4dfe
- [VLM] Support pan-and-scan for Gemma3 multi-modal processor (#14672) · 38240392
  Cyrus Leung authored Mar 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  38240392
- [Bugfix] Fix chunked prefill for GGUF (#14666) · 55211b01
  Szymon Ożóg authored Mar 13, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@aleph-alpha.com>
```
  55211b01