Commits · 8fcaaf6a165e661f63fc51be906bc05b0767332f · OpenDAS / vllm_cscc

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
08 Oct, 2025 1 commit
- [NIXL][non-cuda] Add install script for nixl with non-cuda ucx (#25959) · 9fc983c7
  Chendi.Xue authored Oct 08, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  9fc983c7
07 Oct, 2025 1 commit
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
05 Oct, 2025 1 commit
- Add documentation for granite 4 tool calling (#26175) · e0986ea0
  Maximilien de Bayser authored Oct 05, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e0986ea0
02 Oct, 2025 2 commits
- [Small] Prevent bypassing media domain restriction via HTTP redirects (#26035) · ad87ba92
  Chenheli Hua authored Oct 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ad87ba92
- [CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529
  Cyrus Leung authored Oct 03, 2025
```
[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d00d6529
01 Oct, 2025 1 commit
- Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) · 99028fda
  Param authored Sep 30, 2025
```
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
```
  99028fda
30 Sep, 2025 2 commits
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
- Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717) · 78a47f87
  Andrew Sansom authored Sep 29, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  78a47f87
29 Sep, 2025 1 commit
- [NIXL] Increase default KV block eviction timeout on P (#25897) · 2e4fe48c
  Nicolò Lucchesi authored Sep 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e4fe48c
28 Sep, 2025 1 commit
- Update GLM-4.5 Doc transformers version (#25830) · b1ded114
  Yuxuan Zhang authored Sep 28, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  b1ded114
27 Sep, 2025 1 commit

Add option to restrict media domains (#25783) · 3958b96b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>

3958b96b

26 Sep, 2025 1 commit
- Support LongCat-Flash-Chat tool call (#24083) · b03b1b97
  Xu Wenqing authored Sep 26, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  b03b1b97
25 Sep, 2025 1 commit

Add backward compatibility for `guided_...` API (#25615) · 70fbdb26

Harry Mellor authored Sep 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

70fbdb26

24 Sep, 2025 2 commits

[Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
8c853050

[docs] fix nixl kv_connector_extra_config.backends key (#25565) · b1068903

Peter Pan authored Sep 24, 2025

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b1068903

23 Sep, 2025 3 commits
- [Docs] NixlConnector quickstart guide (#24249) · da5e7e43
  Peter Pan authored Sep 23, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Nicolò Lucchesi<nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  da5e7e43
- [Frontend] Add a new xml-based tool parser for qwen3-coder (#25028) · 9383cd6f
  Zhikaiiii authored Sep 23, 2025
```
Signed-off-by: Zhikaiiii <1658973216@qq.com>
```
  9383cd6f
- [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) · 5774b0a1
  Chendi.Xue authored Sep 22, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  5774b0a1
22 Sep, 2025 1 commit
- [KV offload][5/N] Add `CPUOffloadingSpec` (#24251) · 8db29392
  Or Ozeri authored Sep 22, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  8db29392
20 Sep, 2025 1 commit
- [docs] Prompt Embedding feature support (#25288) · b8a287a0
  Andrew Sansom authored Sep 19, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  b8a287a0
18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 1 commit

[V1] Logits processor docs (#22919) · 7ae98875

afeldman-nm authored Sep 17, 2025

Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Joseph Marinier <Joseph.Marinier@gmail.com>

7ae98875

13 Sep, 2025 2 commits

[Docs] Remove Neuron install doc as backend no longer exists (#24396) · abc7989a
Harry Mellor authored Sep 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
abc7989a

[Frontend][Multimodal] Allow skipping media data when UUIDs are provided. (#23950) · 7f2ea707

Chenheli Hua authored Sep 12, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>

7f2ea707

10 Sep, 2025 1 commit
- [Doc] Add documentation for GLM-4.5 series models: tool-calling and reasoning parser (#24589) · 36cacd09
  Robin authored Sep 10, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  36cacd09
09 Sep, 2025 1 commit
- [Doc]: fixing typos to improve docs (#24480) · 46876dff
  Didier Durand authored Sep 09, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  46876dff
08 Sep, 2025 2 commits

[Docs] Move feature compatibility tables to README (#24431) · 717fc00e
Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
717fc00e

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) · 01dfb5e9

Chenheli Hua authored Sep 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01dfb5e9

31 Aug, 2025 1 commit
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
28 Aug, 2025 1 commit
- [Doc]: fix typos in .md files (including those of #23751) (#23825) · d99c3a4f
  Didier Durand authored Aug 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d99c3a4f
26 Aug, 2025 1 commit
- [Docs] Move quant supported hardware table to README (#23663) · 6421b66b
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6421b66b
25 Aug, 2025 1 commit

[Doc: ]fix various typos in multiple files (#23487) · 47455c42

Didier Durand authored Aug 25, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47455c42

23 Aug, 2025 1 commit
- Support DeepSeek-V3.1 tool call (#23454) · b8f17f5d
  Xu Wenqing authored Aug 23, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  b8f17f5d
22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
17 Aug, 2025 1 commit
- [Misc] fix typo in the multimodal doc (#23051) · 16bff144
  Kevinzz authored Aug 17, 2025
  
  16bff144
16 Aug, 2025 1 commit

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

13 Aug, 2025 1 commit
- [Doc] Add max_lora_rank configuration guide (#22782) · 3f52738d
  633WHU authored Aug 13, 2025
```
Signed-off-by: chiliu <cliu_whu@yeah.net>
```
  3f52738d
12 Aug, 2025 1 commit
- [Doc] Added unmentioned required option "method" in the usage of EAGLE-3 based models (#21737) · 3a7e3bbd
  Hongsheng Liu authored Aug 12, 2025
```
Signed-off-by: Dilute-l <dilu2333@163.com>
Co-authored-by: Dilute-l <dilu2333@163.com>
```
  3a7e3bbd