Commits · 304dcdf5758fdbf0252966b6b0791bbba9254feb · OpenDAS / vllm_cscc

28 Jul, 2025 5 commits

Migrate GLMVImagePixelInputs to TensorSchema (#21679) · 304dcdf5
Benji Beck authored Jul 27, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
304dcdf5

Migrate Glm4vImageInputs, Glm4vVideoInputs to TensorSchema (#21678) · 88e46c7c

Benji Beck authored Jul 27, 2025


Signed-off-by: Benji Beck <benjibeck@meta.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

88e46c7c

Migrate Gemma3ImagePixelInputs to TensorSchema (#21676) · d8937de4
Benji Beck authored Jul 27, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
d8937de4

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674) · c7ffe93d

Shinichi Hemmi authored Jul 28, 2025


Signed-off-by: Shinichi Hemmi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: Calvin Metzger <metzger@preferred.jp>
Co-authored-by: Sixue Wang <cecilwang@preferred.jp>

c7ffe93d

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 7 commits
- [VLM] Add video support for Intern-S1 (#21671) · 3d847a31
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3d847a31
- Migrate Florence2ImagePixelInputs to TensorSchema (#21663) · 5f8c9a42
  Benji Beck authored Jul 27, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  5f8c9a42
- [VLM] Support HF format Phi-4-MM model (#17121) · eed2f463
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  eed2f463
- Migrate ChameleonImagePixelInputs to TensorSchema (#21657) · 20950b29
  Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  20950b29
- Migrate FuyuImagePatchInputs to TensorSchema (#21662) · 3339cba3
  Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  3339cba3
- Migrate DeepseekVL2ImageInputs to TensorSchema (#21658) · 0b8caf90
  Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  0b8caf90
- Migrate Blip2ImagePixelInputs and Blip2ImageEmbeddingInputs to TensorSchema (#21656) · ccf27cc4
  Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  ccf27cc4
26 Jul, 2025 7 commits

support `torch.compile` for bailing moe (#21664) · c6573698
Jinzhen Lin authored Jul 27, 2025

c6573698
Remove xformers requirement for Mistral-format Pixtral and Mistral3 (#21154) · 6c66f28f
Wenchen Lo authored Jul 26, 2025
```
Signed-off-by: Wenchen Lo <charles761013@gmail.com>
```
6c66f28f

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

Migrate AyaVisionImagePixelInputs to TensorSchema for shape validation (#21622) · de10ff0b
Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
de10ff0b
Migrate AriaImagePixelInputs to TensorSchema for shape validation (#21620) · 9d197280
Benji Beck authored Jul 26, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
9d197280

Support Intern-S1 (#21628) · 875af38e

Lyu Han authored Jul 26, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

875af38e

[Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) · 62965de5

Farzad Abdolhosseini authored Jul 26, 2025


Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>

62965de5

25 Jul, 2025 9 commits
- Add support for Prithvi in Online serving mode (#21518) · e189b50f
  mgazz authored Jul 25, 2025
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e189b50f
- [MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931) · 29c6fbe5
  bigshanedogg authored Jul 25, 2025
```
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
```
  29c6fbe5
- [Model] Fix Ernie4.5MoE e_score_correction_bias parameter (#21586) · c72f049c
  xyxinyang authored Jul 25, 2025
```
Signed-off-by: zhouchong <zhouchong03@baidu.com>
Co-authored-by: zhouchong <zhouchong03@baidu.com>
```
  c72f049c
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69
- [Quantization] Enable BNB support for more MoE models (#21370) · 5c3f2628
  Jee Jee Li authored Jul 25, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  5c3f2628
- [Model] Fix a check for None but the return value was empty list in Gemma3 MM... · fde60ee7
  hfan authored Jul 25, 2025
```
[Model] Fix a check for None but the return value was empty list in Gemma3 MM vision_embeddings (#21479)
Signed-off-by: Hongmin Fan <fanhongmin@google.com>
```
  fde60ee7
- [Model] Support tensor parallel for timm ViT in Deepseek_vl2 (#21494) · b38bc652
  Jason Gu authored Jul 25, 2025
```
Signed-off-by: wzqd <1057337859@qq.com>
```
  b38bc652
- Integrate TensorSchema with shape validation for Phi3VImagePixelInputs (#21232) · 965bc71b
  Benji Beck authored Jul 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  965bc71b
- Fix GLM-4 PP Missing Layer When using with PP. (#21531) · 2ce90e5b
  Yuxuan Zhang authored Jul 25, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2ce90e5b
24 Jul, 2025 3 commits
- [Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13abd0ea
- remove GLM-4.5 quantization wrong Code (#21435) · 85bda9e7
  Yuxuan Zhang authored Jul 24, 2025
  
  85bda9e7
- Deduplicate Transformers backend code using inheritance (#21461) · dde295a9
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dde295a9
23 Jul, 2025 6 commits
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [Model] add Hunyuan V1 Dense Model support. (#21368) · 2671334d
  Asher authored Jul 23, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  2671334d
- add clear messages for deprecated models (#21424) · 2f5c14de
  youkaichao authored Jul 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2f5c14de
- [Bugfix] Fix nightly transformers CI failure (#21427) · 4ecedd18
  Isotr0py authored Jul 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  4ecedd18
- [BUGFIX] deepseek-v2-lite failed due to fused_qkv_a_proj name update (#21414) · 08d2bd78
  Chendi.Xue authored Jul 22, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  08d2bd78
- Simplify weight loading in Transformers backend (#21382) · f154bb9f
  Harry Mellor authored Jul 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f154bb9f
22 Jul, 2025 3 commits
- [Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()`... · 2226d5bd
  Aritra Roy Gosthipaty authored Jul 22, 2025
```
[Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()` with `model_impl=transformers` (#21353)
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>
```
  2226d5bd
- [feat] Enable mm caching for transformers backend (#21358) · f38ee34a
  Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  f38ee34a
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914