Commits · 46cbbca05c31372f672476f5fc3f37b8bbdd5457 · OpenDAS / vllm_cscc

04 Dec, 2025 3 commits

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c

wang.yuqi authored Dec 04, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

74c4d80c

[P/D] Introduce Mooncake Transfer Engine as kv_connector (#24718) · 842aba50

dtc authored Dec 04, 2025


Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Signed-off-by: dtc <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

842aba50

[Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9ae2f603

29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
28 Nov, 2025 1 commit
- [Docs] Update supported models for Olmo 3 in tool calling documentation (#29411) · 18523b87
  Wilson Wu authored Nov 28, 2025
```
Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
```
  18523b87
25 Nov, 2025 1 commit
- Scheduled removal of `guided_*` config fields (#29326) · 316c8492
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  316c8492
24 Nov, 2025 1 commit
- Remove VLLM_SKIP_WARMUP tip (#29331) · 4dd42db5
  Tyler Michael Smith authored Nov 24, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  4dd42db5
21 Nov, 2025 3 commits

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

[Core] Add audio_embeds support to chat completions (#29059) · 07304149
jeremyteboul authored Nov 20, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
07304149

[Doc] cleanup TPU documentation and remove outdated examples (#29048) · dd39f91e

Rob Mulla authored Nov 20, 2025

Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dd39f91e

19 Nov, 2025 3 commits
- [Doc]: fix typos in various files (#29010) · 09540cd9
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  09540cd9
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c
- [Docs] Update oneshot imports (#28188) · 6a25ea5f
  Uranus authored Nov 19, 2025
```
Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
```
  6a25ea5f
18 Nov, 2025 2 commits

[chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78

Kevin H. Luu authored Nov 18, 2025


Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c64c0b78

[Doc]: fix typos in various files (#28863) · 083cf326
Didier Durand authored Nov 18, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
083cf326

16 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28811) · 63fed555
  Didier Durand authored Nov 16, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  63fed555
15 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28567) · 2bb4435c
  Didier Durand authored Nov 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  2bb4435c
13 Nov, 2025 1 commit
- [Frontend] supports interleaved thinking (#28531) · 5c9ad138
  Chauncey authored Nov 13, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5c9ad138
12 Nov, 2025 2 commits

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>

4ca5cd57

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

11 Nov, 2025 2 commits

[ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8

xuebwang-amd authored Nov 12, 2025


Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

05576df8

[Doc] Sleep mode documentation (#28357) · a7adbc6c

iAmir97 authored Nov 11, 2025

Signed-off-by: Amir Balwel <amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: Amir Balwel <amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a7adbc6c

09 Nov, 2025 1 commit
- [chore] Move some wikimedia images to S3 (#28351) · 05f8d690
  Kevin H. Luu authored Nov 08, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  05f8d690
08 Nov, 2025 1 commit
- `reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
  Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d9ab1ad9
05 Nov, 2025 2 commits
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [Refactor] Lazy-loaded reasoning_parser (#28092) · e261d37c
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  e261d37c
04 Nov, 2025 1 commit
- [Refactor] Lazy import tool_parser (#27974) · c02fccdb
  Chauncey authored Nov 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c02fccdb
03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
31 Oct, 2025 2 commits

Batch invariance doc (#27839) · 0e0a638c

Bram Wasti authored Oct 31, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0e0a638c

[Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3

GuanLuo authored Nov 01, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

d6517be3

27 Oct, 2025 2 commits
- [Doc] Slight improvement to M2 and beyond (#27554) · 2d631d28
  Jee Jee Li authored Oct 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  2d631d28
- [Docs] reemove the incorrect `enable_reasoning` parameter (#27550) · 181bf5bb
  yyzxw authored Oct 27, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  181bf5bb
23 Oct, 2025 1 commit
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
22 Oct, 2025 1 commit

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

18 Oct, 2025 1 commit
- [DOC][FEATURES][CPU]update cpu feature for v1 (#27135) · 12e21701
  Chendi.Xue authored Oct 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  12e21701
17 Oct, 2025 2 commits
- [Docs] Replace all explicit anchors with real links (#27087) · 483ea646
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  483ea646
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
16 Oct, 2025 1 commit

[DOC][XPU]update feature parity with Intel GPU (#26954) · 509cdc03

Chendi.Xue authored Oct 15, 2025


Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>

509cdc03

15 Oct, 2025 2 commits
- Olmo 3 tool parser and tests (#26143) · 4794c2bd
  Pradeep Dasigi authored Oct 15, 2025
```
Signed-off-by: Pradeep Dasigi <pradeepd@allenai.org>
```
  4794c2bd
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c