Commits · 807a328bb6875d977de066c0ad67ceade5ccfb8b · OpenDAS / vllm_cscc

25 Jul, 2025 1 commit
- Fix GLM-4 PP Missing Layer When using with PP. (#21531) · 2ce90e5b
  Yuxuan Zhang authored Jul 25, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2ce90e5b
24 Jul, 2025 3 commits
- [Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13abd0ea
- remove GLM-4.5 quantization wrong Code (#21435) · 85bda9e7
  Yuxuan Zhang authored Jul 24, 2025
  
  85bda9e7
- Deduplicate Transformers backend code using inheritance (#21461) · dde295a9
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dde295a9
23 Jul, 2025 6 commits
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Model] add Hunyuan V1 Dense Model support. (#21368) · 2671334d
  Asher authored Jul 23, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  2671334d
- add clear messages for deprecated models (#21424) · 2f5c14de
  youkaichao authored Jul 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2f5c14de
- [Bugfix] Fix nightly transformers CI failure (#21427) · 4ecedd18
  Isotr0py authored Jul 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  4ecedd18
- [BUGFIX] deepseek-v2-lite failed due to fused_qkv_a_proj name update (#21414) · 08d2bd78
  Chendi.Xue authored Jul 22, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  08d2bd78
- Simplify weight loading in Transformers backend (#21382) · f154bb9f
  Harry Mellor authored Jul 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f154bb9f
22 Jul, 2025 4 commits

[Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()`... · 2226d5bd

Aritra Roy Gosthipaty authored Jul 22, 2025


[Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()` with `model_impl=transformers` (#21353)
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>

2226d5bd

[feat] Enable mm caching for transformers backend (#21358) · f38ee34a
Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
f38ee34a
[perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
4fb56914

Add arcee model (#21296) · 82b8027b

Raghav Ravishankar authored Jul 22, 2025


Signed-off-by: alyosha-swamy <raghav@arcee.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

82b8027b

21 Jul, 2025 1 commit
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
20 Jul, 2025 2 commits

[Model] Support VLMs with transformers backend (#20543) · 9499e26e

Raushan Turganbay authored Jul 20, 2025


Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9499e26e

[Model] use AutoWeightsLoader for bart (#18299) · 51ba8395
Calvin Chen authored Jul 20, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
51ba8395

19 Jul, 2025 7 commits
- GLM-4 Update (#20736) · 10eb24cc
  Yuxuan Zhang authored Jul 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>
```
  10eb24cc
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
- [Model] EXAONE 4.0 model support (#21060) · 3e04107d
  김종곤 authored Jul 19, 2025
```
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
```
  3e04107d
- [V0 Deprecation] Remove V0 Spec Decode workers (#21152) · dd572c0a
  Woosuk Kwon authored Jul 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dd572c0a
- [Quantization] Enable BNB support for more MoE models (#21100) · 466e878f
  Jee Jee Li authored Jul 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  466e878f
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
18 Jul, 2025 3 commits
- Let GraniteMoeAttention use YaRN (#21174) · ed8cbfed
  Thomas Parnell authored Jul 18, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ed8cbfed
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
- [Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103) · ca4eb82b
  wang.yuqi authored Jul 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  ca4eb82b
17 Jul, 2025 4 commits
- [Misc] Qwen MoE model supports LoRA (#20932) · a3a6c695
  Jee Jee Li authored Jul 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a3a6c695
- [Model] Update pooling model interface (#21058) · 90bd2ab6
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90bd2ab6
- [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c
  kYLe authored Jul 17, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4ef00b5c
- [Misc] Fix PhiMoE expert mapping (#21085) · c5b8b595
  Jee Jee Li authored Jul 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c5b8b595
16 Jul, 2025 8 commits
- [Model] Remove model sampler (#21059) · ac2bf41e
  Cyrus Leung authored Jul 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac2bf41e
- [fix] fix qwen image_embeds input (#21049) · a0f8a796
  Avshalom Manevich authored Jul 16, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  a0f8a796
- [Model] Consolidate pooler implementations (#20927) · 1c3198b6
  Cyrus Leung authored Jul 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1c3198b6
- [Meta] Llama4 EAGLE Support (#20591) · c11013db
  zhiweiz authored Jul 15, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>
```
  c11013db
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Bugfix] Fix Mistral3 support on SM100/SM120 (#20998) · f4609833
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f4609833
- [Chore] Remove outdated transformers check (#20989) · 75a99b98
  Brayden Zhong authored Jul 15, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  75a99b98
- [Model] Add ModelConfig class for GraniteMoeHybrid to override default... · 6cbc4d4b
  Thomas Parnell authored Jul 16, 2025
```
[Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  6cbc4d4b
15 Jul, 2025 1 commit

Voxtral (#20970) · e7e3e6d2

Patrick von Platen authored Jul 15, 2025


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

e7e3e6d2