Commits · 2c19d96777939dd3473eabfacbe1948a3ea0b4be · OpenDAS / vllm_cscc

03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
31 Oct, 2025 2 commits

Batch invariance doc (#27839) · 0e0a638c

Bram Wasti authored Oct 31, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0e0a638c

[Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3

GuanLuo authored Nov 01, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

d6517be3

27 Oct, 2025 2 commits
- [Doc] Slight improvement to M2 and beyond (#27554) · 2d631d28
  Jee Jee Li authored Oct 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  2d631d28
- [Docs] reemove the incorrect `enable_reasoning` parameter (#27550) · 181bf5bb
  yyzxw authored Oct 27, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  181bf5bb
23 Oct, 2025 1 commit
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
22 Oct, 2025 1 commit

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

18 Oct, 2025 1 commit
- [DOC][FEATURES][CPU]update cpu feature for v1 (#27135) · 12e21701
  Chendi.Xue authored Oct 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  12e21701
17 Oct, 2025 2 commits
- [Docs] Replace all explicit anchors with real links (#27087) · 483ea646
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  483ea646
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
16 Oct, 2025 1 commit

[DOC][XPU]update feature parity with Intel GPU (#26954) · 509cdc03

Chendi.Xue authored Oct 15, 2025


Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>

509cdc03

15 Oct, 2025 4 commits

Olmo 3 tool parser and tests (#26143) · 4794c2bd
Pradeep Dasigi authored Oct 15, 2025
```
Signed-off-by: Pradeep Dasigi <pradeepd@allenai.org>
```
4794c2bd
[Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
8f4b313c
[Doc] ruff format remaining Python examples (#26795) · 62566979
Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
62566979

[Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589) · 85a65e7f

Tao Hui authored Oct 15, 2025


Signed-off-by: taohui <taohui3@gmail.com>
Signed-off-by: Tao Hui <taohui3@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

85a65e7f

14 Oct, 2025 3 commits
- Notice for deprecation of AutoAWQ (#26820) · b92ab3de
  HDCharles authored Oct 14, 2025
```
Signed-off-by: HDCharles <39544797+HDCharles@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b92ab3de
- [Doc] ruff format some Python examples (#26767) · ef9676a1
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef9676a1
- [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) · 7e6edb14
  Chendi.Xue authored Oct 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  7e6edb14
13 Oct, 2025 1 commit
- [Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027) · 782505ed
  CSWYF3634076 authored Oct 13, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  782505ed
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
08 Oct, 2025 1 commit
- [NIXL][non-cuda] Add install script for nixl with non-cuda ucx (#25959) · 9fc983c7
  Chendi.Xue authored Oct 08, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  9fc983c7
07 Oct, 2025 1 commit
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
05 Oct, 2025 1 commit
- Add documentation for granite 4 tool calling (#26175) · e0986ea0
  Maximilien de Bayser authored Oct 05, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e0986ea0
02 Oct, 2025 2 commits
- [Small] Prevent bypassing media domain restriction via HTTP redirects (#26035) · ad87ba92
  Chenheli Hua authored Oct 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ad87ba92
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
01 Oct, 2025 1 commit
- Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) · 99028fda
  Param authored Sep 30, 2025
```
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
```
  99028fda
30 Sep, 2025 2 commits
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
- Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) · 78a47f87
  Andrew Sansom authored Sep 29, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  78a47f87
29 Sep, 2025 1 commit
- [NIXL] Increase default KV block eviction timeout on P (#25897) · 2e4fe48c
  Nicolò Lucchesi authored Sep 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e4fe48c
28 Sep, 2025 1 commit
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
27 Sep, 2025 1 commit

Add option to restrict media domains (#25783) · 3958b96b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>

3958b96b

26 Sep, 2025 1 commit
- Support LongCat-Flash-Chat tool call (#24083) · b03b1b97
  Xu Wenqing authored Sep 26, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  b03b1b97
25 Sep, 2025 1 commit

Add backward compatibility for `guided_...` API (#25615) · 70fbdb26

Harry Mellor authored Sep 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

70fbdb26

24 Sep, 2025 2 commits

[Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
8c853050

[docs] fix nixl kv_connector_extra_config.backends key (#25565) · b1068903

Peter Pan authored Sep 24, 2025

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b1068903

23 Sep, 2025 3 commits
- [Docs] NixlConnector quickstart guide (#24249) · da5e7e43
  Peter Pan authored Sep 23, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Nicolò Lucchesi<nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  da5e7e43
- [Frontend] Add a new xml-based tool parser for qwen3-coder (#25028) · 9383cd6f
  Zhikaiiii authored Sep 23, 2025
```
Signed-off-by: Zhikaiiii <1658973216@qq.com>
```
  9383cd6f
- [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) · 5774b0a1
  Chendi.Xue authored Sep 22, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  5774b0a1
22 Sep, 2025 1 commit
- [KV offload][5/N] Add `CPUOffloadingSpec` (#24251) · 8db29392
  Or Ozeri authored Sep 22, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  8db29392