Commits · 217937221b6845913502371aba554a3357fbccfb · OpenDAS / vllm_cscc

19 Jul, 2025 1 commit
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
18 Jul, 2025 3 commits
- Let GraniteMoeAttention use YaRN (#21174) · ed8cbfed
  Thomas Parnell authored Jul 18, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ed8cbfed
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
- [Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103) · ca4eb82b
  wang.yuqi authored Jul 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  ca4eb82b
17 Jul, 2025 4 commits
- [Misc] Qwen MoE model supports LoRA (#20932) · a3a6c695
  Jee Jee Li authored Jul 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a3a6c695
- [Model] Update pooling model interface (#21058) · 90bd2ab6
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90bd2ab6
- [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c
  kYLe authored Jul 17, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4ef00b5c
- [Misc] Fix PhiMoE expert mapping (#21085) · c5b8b595
  Jee Jee Li authored Jul 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c5b8b595
16 Jul, 2025 8 commits
- [Model] Remove model sampler (#21059) · ac2bf41e
  Cyrus Leung authored Jul 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac2bf41e
- [fix] fix qwen image_embeds input (#21049) · a0f8a796
  Avshalom Manevich authored Jul 16, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  a0f8a796
- [Model] Consolidate pooler implementations (#20927) · 1c3198b6
  Cyrus Leung authored Jul 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1c3198b6
- [Meta] Llama4 EAGLE Support (#20591) · c11013db
  zhiweiz authored Jul 15, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>
```
  c11013db
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Bugfix] Fix Mistral3 support on SM100/SM120 (#20998) · f4609833
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4609833
- [Chore] Remove outdated transformers check (#20989) · 75a99b98
  Brayden Zhong authored Jul 15, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  75a99b98
- [Model] Add ModelConfig class for GraniteMoeHybrid to override default... · 6cbc4d4b
  Thomas Parnell authored Jul 16, 2025
```
[Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  6cbc4d4b
15 Jul, 2025 3 commits
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- [Model] Add AutoWeightsLoader support for BERT, RoBERTa (#20534) · 85bd6599
  Jennifer He authored Jul 15, 2025
```
Signed-off-by: Jennifer He <islandhe@gmail.com>
Signed-off-by: <islandhe@gmail.com>
Signed-off-by: Jen H <islandhe@gmail.com>
```
  85bd6599
14 Jul, 2025 2 commits
- [Model] Add Ling implementation (#20680) · 38efa282
  ant-yy authored Jul 14, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
```
  38efa282
- [Quantization] add BNB for MixtralForCausalLM (#20893) · a99b9f7d
  Jee Jee Li authored Jul 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a99b9f7d
13 Jul, 2025 2 commits

Support for LlamaForSequenceClassification (#20807) · bd4c1e6f
Minkyu Kim authored Jul 13, 2025
```
Signed-off-by: thechaos16 <thechaos16@gmail.com>
```
bd4c1e6f

[Core] Support multiple tasks per model (#20771) · 020f58ab

Nicolò Lucchesi authored Jul 13, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

020f58ab

12 Jul, 2025 6 commits
- [Bugfix] Fix Tensor Parallelism Padding Consistency in Granite Models (#20843) · c2a2f19a
  Alex Brooks authored Jul 12, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  c2a2f19a
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
- Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419) · 4afe687a
  Zhiyu authored Jul 11, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  4afe687a
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- [CI/Build] Ensure compatability with Transformers v4.53 (#20541) · 01cae377
  Isotr0py authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  01cae377
- [Bugfix] Fix tensor parallel issue in Qwen3 reranker weight loading (#20682) · 11c01986
  yurhett authored Jul 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  11c01986
11 Jul, 2025 3 commits
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f
- [Model] Support HF format of minimax (#20211) · 922f3164
  Michael Goin authored Jul 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  922f3164
10 Jul, 2025 3 commits
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- Correct PPMissingLayer handling in Deepseek-V2-Lite PP deployment (#20665) · ad6c2e1a
  Seiji Eicher authored Jul 09, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  ad6c2e1a
09 Jul, 2025 1 commit

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6

Tuan, Hoang-Trong authored Jul 09, 2025


Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

47043eb6

08 Jul, 2025 4 commits
- [Bugfix] Fix GLM-4.1-V video prompt update (#20635) · b9fca832
  Isotr0py authored Jul 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b9fca832
- [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630) · 32dffc27
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32dffc27
- Revert invalid spellchecker fix on deepseek_vl2 (#20618) · c6c22f16
  viravera authored Jul 08, 2025
  
  c6c22f16
- [Model] Implement missing `get_language_model` for Keye-VL (#20631) · dd382e0f
  Cyrus Leung authored Jul 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dd382e0f