Commits · 4ccffe561f0bc9fe007fdaafe8342171592db7db · OpenDAS / vllm_cscc

12 Nov, 2025 1 commit

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

11 Nov, 2025 2 commits

[ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8

xuebwang-amd authored Nov 12, 2025


Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

05576df8

[Doc] Sleep mode documentation (#28357) · a7adbc6c

iAmir97 authored Nov 11, 2025

Signed-off-by: Amir Balwel <amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: Amir Balwel <amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a7adbc6c

09 Nov, 2025 1 commit
- [chore] Move some wikimedia images to S3 (#28351) · 05f8d690
  Kevin H. Luu authored Nov 08, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  05f8d690
08 Nov, 2025 1 commit
- `reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
  Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d9ab1ad9
05 Nov, 2025 2 commits
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [Refactor] Lazy-loaded reasoning_parser (#28092) · e261d37c
  Chauncey authored Nov 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  e261d37c
04 Nov, 2025 1 commit
- [Refactor] Lazy import tool_parser (#27974) · c02fccdb
  Chauncey authored Nov 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c02fccdb
03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
31 Oct, 2025 2 commits

Batch invariance doc (#27839) · 0e0a638c

Bram Wasti authored Oct 31, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0e0a638c

[Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3

GuanLuo authored Nov 01, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

d6517be3

27 Oct, 2025 2 commits
- [Doc] Slight improvement to M2 and beyond (#27554) · 2d631d28
  Jee Jee Li authored Oct 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  2d631d28
- [Docs] reemove the incorrect `enable_reasoning` parameter (#27550) · 181bf5bb
  yyzxw authored Oct 27, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  181bf5bb
23 Oct, 2025 1 commit
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
22 Oct, 2025 1 commit

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

18 Oct, 2025 1 commit
- [DOC][FEATURES][CPU]update cpu feature for v1 (#27135) · 12e21701
  Chendi.Xue authored Oct 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  12e21701
17 Oct, 2025 2 commits
- [Docs] Replace all explicit anchors with real links (#27087) · 483ea646
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  483ea646
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
16 Oct, 2025 1 commit

[DOC][XPU]update feature parity with Intel GPU (#26954) · 509cdc03

Chendi.Xue authored Oct 15, 2025


Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>

509cdc03

15 Oct, 2025 4 commits

Olmo 3 tool parser and tests (#26143) · 4794c2bd
Pradeep Dasigi authored Oct 15, 2025
```
Signed-off-by: Pradeep Dasigi <pradeepd@allenai.org>
```
4794c2bd
[Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
8f4b313c
[Doc] ruff format remaining Python examples (#26795) · 62566979
Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
62566979

[Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589) · 85a65e7f

Tao Hui authored Oct 15, 2025


Signed-off-by: taohui <taohui3@gmail.com>
Signed-off-by: Tao Hui <taohui3@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

85a65e7f

14 Oct, 2025 3 commits
- Notice for deprecation of AutoAWQ (#26820) · b92ab3de
  HDCharles authored Oct 14, 2025
```
Signed-off-by: HDCharles <39544797+HDCharles@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b92ab3de
- [Doc] ruff format some Python examples (#26767) · ef9676a1
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef9676a1
- [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) · 7e6edb14
  Chendi.Xue authored Oct 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  7e6edb14
13 Oct, 2025 1 commit
- [Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027) · 782505ed
  CSWYF3634076 authored Oct 13, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  782505ed
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
08 Oct, 2025 1 commit
- [NIXL][non-cuda] Add install script for nixl with non-cuda ucx (#25959) · 9fc983c7
  Chendi.Xue authored Oct 08, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  9fc983c7
07 Oct, 2025 1 commit
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
05 Oct, 2025 1 commit
- Add documentation for granite 4 tool calling (#26175) · e0986ea0
  Maximilien de Bayser authored Oct 05, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e0986ea0
02 Oct, 2025 2 commits
- [Small] Prevent bypassing media domain restriction via HTTP redirects (#26035) · ad87ba92
  Chenheli Hua authored Oct 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ad87ba92
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
01 Oct, 2025 1 commit
- Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) · 99028fda
  Param authored Sep 30, 2025
```
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
```
  99028fda
30 Sep, 2025 2 commits
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
- Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) · 78a47f87
  Andrew Sansom authored Sep 29, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  78a47f87
29 Sep, 2025 1 commit
- [NIXL] Increase default KV block eviction timeout on P (#25897) · 2e4fe48c
  Nicolò Lucchesi authored Sep 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e4fe48c
28 Sep, 2025 1 commit
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
27 Sep, 2025 1 commit

Add option to restrict media domains (#25783) · 3958b96b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>

3958b96b