Commits · c905684cfeaee3b2be2c736eee473b2c6ae7f7bf · OpenDAS / vllm_cscc

27 Aug, 2025 2 commits
- [Core] Asynchronous h2d in merge_multimodal_embeddings via pinned memory. (#23686) · c905684c
  Chenheli Hua authored Aug 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c905684c
- [Bugfix][gpt-oss] passing the cache config in gpt-oss (#23613) · fecbb7c7
  Wei authored Aug 26, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  fecbb7c7
26 Aug, 2025 6 commits
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [model] support qwen2audio embedding input (#23625) · 9d4183dd
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9d4183dd
- [Model] fix DeepSeek e_score_correction_bias dtype to fp32 (#23640) · fdeb3dac
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdeb3dac
- [Bugfix] Fix Qwen25VL packed_modules_mapping (#23604) · 9b5f6423
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  9b5f6423
- [mypy] Fix incorrect type hint for EAGLE3 support (#23617) · 7d67a9d9
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d67a9d9
25 Aug, 2025 10 commits
- [Bugfix] Fix Qwen3 MoE GPTQ inference (#23490) · a9082a4d
  Isotr0py authored Aug 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a9082a4d
- [Refactor] Pass `tokenizer` explicitly instead of binding to prompt update (#23542) · 6879cd80
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6879cd80
- [Attention] Unify mamba and attention backend selection (#23171) · 5c4b6e66
  Ayush Satyam authored Aug 25, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
```
  5c4b6e66
- [Bugfix] Allow dynamic number of patches for llava_onevision (#23525) · ebafb093
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebafb093
- [Refactor] Dynamic `target` and `content` for prompt updates (#23411) · 712d0f88
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  712d0f88
- [Bugfix] Fix Dense module loading for sentence-transformers embedding models... · c9abb104
  LIYIFAN_liyifan authored Aug 24, 2025
```
[Bugfix] Fix Dense module loading for sentence-transformers embedding models (simplified V2) (#23408)
Signed-off-by: FFFfff1FFFfff <yifanli0919@gmail.com>
```
  c9abb104
- Migrate DonutImagePixelInputs to TensorSchema (#23509) · 787cdb38
  Benji Beck authored Aug 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  787cdb38
- Migrate skyworkr1v inputs to TensorSchema (#23499) · a5203d04
  Benji Beck authored Aug 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a5203d04
- Migrate tarsier inputs to TensorSchema (#23500) · 99f80944
  Benji Beck authored Aug 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  99f80944
- [Bugfix] Fix Qwen2.5-VL quantized model weights loading (#23512) · a71e4765
  zifeitong authored Aug 24, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  a71e4765
24 Aug, 2025 4 commits
- [Model] Enable BLOOM on V1 (#23488) · e2db1164
  Cyrus Leung authored Aug 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2db1164
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
- Migrate Paligemma inputs to TensorSchema (#23470) · a7527728
  Benji Beck authored Aug 23, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a7527728
- Migrate Pixtral inputs to TensorSchema (#23472) · 053278a5
  Benji Beck authored Aug 23, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  053278a5
23 Aug, 2025 1 commit
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
22 Aug, 2025 8 commits
- [Bugfix] Fix broken Florence-2 model (#23426) · cd7a3df2
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  cd7a3df2
- [Model] Add Ovis2.5 PP support (#23405) · 32d2b406
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32d2b406
- [BugFix] Fix the issue where image embeddings were incorrectly split.… (#23366) · 424fb7a5
  bppps authored Aug 23, 2025
```
Signed-off-by: bppps <bpppsaka@gmail.com>
Co-authored-by: zouyu.zzx <zouyu.zzx@alibaba-inc.com>
Co-authored-by: bppps <bpppsaka@gmail.com>
```
  424fb7a5
- [Speculators][Speculative Decoding] Fix Qwen 2 Eagle3 Support (#23337) · 88491c1b
  PapaGoose authored Aug 22, 2025
  
  88491c1b
- Migrate MiniCPMOAudioInputs to TensorSchema (#21847) · 99872085
  Benji Beck authored Aug 22, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  99872085
- [Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154) · 17373dcd
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  17373dcd
- [New Model] Add Seed-Oss model (#23241) · 59640693
  Bin Jia authored Aug 22, 2025
```
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  59640693
- Migrate MllamaImagePixelInputs to TensorSchema (#22020) · 0b9cc56f
  Benji Beck authored Aug 21, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0b9cc56f
21 Aug, 2025 8 commits

Migrate MolmoImageInputs to TensorSchema (#22022) · a482e4e7
Benji Beck authored Aug 21, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
a482e4e7

[Multimodal] Always enable hashing mm data (#23308) · 79f05e44

Roger Wang authored Aug 21, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

79f05e44

[Performance] V1 Pooling Models E2E Performance Optimization (#23162) · d70a1662
wang.yuqi authored Aug 21, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
d70a1662
[Model] Add LFM2 architecture (#22845) · 2e2000f3
Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
2e2000f3
[Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0c31e28e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c

Asaf Joseph Gardin authored Aug 21, 2025


Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>

3663870c

[CI/Build] Split out mm processor tests (#23260) · 2461d9e5
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2461d9e5

20 Aug, 2025 1 commit

[Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2

rongfu.leng authored Aug 21, 2025


Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

4fbda0b2