Commits · 50dd4cb42726777635acda9ed4f5440ae4a2e281 · OpenDAS / vllm_cscc

20 Apr, 2026 1 commit

[EPLB] Add nixl-based eplb communicator (#36276) · 50dd4cb4

Ilya Markov authored Apr 20, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>

50dd4cb4

18 Apr, 2026 1 commit
- [Doc] Add Realtime Transcription section to supported_models.md (#39845) · d0697cc7
  z1ying authored Apr 17, 2026
```
Signed-off-by: Ziying Tao <tzzying@outlook.com>
```
  d0697cc7
16 Apr, 2026 1 commit

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675) · 4e8c3f1c

wang.yuqi authored Apr 16, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

4e8c3f1c

31 Mar, 2026 1 commit

Generative Scoring (#34539) · 2e569756

Vedant V Jhaveri authored Mar 31, 2026


Signed-off-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2e569756

19 Mar, 2026 2 commits

[MoE Refactor] Rename "naive" all2all backend (#36294) · 91be5f9b
bnellnm authored Mar 19, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
91be5f9b

[Docs] Reorganize pooling docs. (#35592) · f9e2a383

wang.yuqi authored Mar 19, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

f9e2a383

16 Mar, 2026 2 commits

[Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
061980c3

[Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b

leo-cf-tian authored Mar 16, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>

2754231b

12 Mar, 2026 1 commit

[Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0

Nick Hill authored Mar 11, 2026


Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

262b76a0

09 Mar, 2026 4 commits

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Online Transcriptions) (#36160) · 65a4da15
Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
65a4da15

[Examples][1/n] Resettle basic examples. (#35579) · dcf8862f

wang.yuqi authored Mar 09, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dcf8862f

[Dependency] Remove default ray dependency (#36170) · 384425f8

Wentao Ye authored Mar 08, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

384425f8

Allow `markdownlint` to run locally (#36398) · a0f44bb6
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a0f44bb6

07 Mar, 2026 1 commit
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
27 Feb, 2026 1 commit

[Doc] Fix link to Llama chat template for usability (#35525) · b602e4f2

Martin Hickey authored Feb 27, 2026

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

b602e4f2

26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

09 Feb, 2026 1 commit
- [Frontend][last/5] Make pooling entrypoints request schema consensus. (#31127) · 22b64948
  wang.yuqi authored Feb 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  22b64948
31 Jan, 2026 1 commit
- [Streaming -> Realtime] Rename all voxtral related classes, fn, files (#33415) · 15e0bb9c
  Patrick von Platen authored Jan 31, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  15e0bb9c
30 Jan, 2026 1 commit
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
29 Jan, 2026 2 commits

[Doc] Update outdated link to Ray documentation (#32660) · d697581a
graftim authored Jan 29, 2026
```
Signed-off-by: graftim <38649219+graftim@users.noreply.github.com>
```
d697581a

[Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65

Didier Durand authored Jan 29, 2026

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

31b25f65

24 Jan, 2026 1 commit
- Auth_token added in documentation as it is required (#32988) · c0d82045
  ruizcrp authored Jan 24, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c0d82045
23 Jan, 2026 2 commits

[Frontend] add logprob, compression_rate to 'verbose_json' features (#31059) · 9b77bb79

sangbumlikeagod authored Jan 24, 2026


Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>

9b77bb79

[Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714

wang.yuqi authored Jan 23, 2026


[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05f3d714

22 Jan, 2026 1 commit
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
19 Jan, 2026 1 commit
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
16 Jan, 2026 1 commit
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd
13 Jan, 2026 1 commit
- Fix various typos found in `docs` (#32212) · f243abc9
  Andrew Bennett authored Jan 12, 2026
```
Signed-off-by: Andrew Bennett <potatosaladx@meta.com>
```
  f243abc9
12 Jan, 2026 2 commits
- [Doc] Add documentation for offline API docs feature (#32134) · a5f89ae2
  RickyChen / 陳昭儒 authored Jan 12, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
```
  a5f89ae2
- [Model] Improve multimodal pooling examples (#32085) · 60446cd6
  wang.yuqi authored Jan 12, 2026
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  60446cd6
08 Jan, 2026 2 commits
- [Docs]: update claude code url (#31971) · 1da3a544
  Chauncey authored Jan 08, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  1da3a544
- [Doc] Add Claude code usage example (#31188) · 6b2a672e
  Michael Goin authored Jan 08, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6b2a672e
23 Dec, 2025 1 commit

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

22 Dec, 2025 1 commit
- [CI Failure] Disable mosaicml/mpt-7b and databricks/dbrx-instruct tests (#31182) · 6d518ffb
  Michael Goin authored Dec 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6d518ffb
17 Dec, 2025 1 commit
- [Doc][ResponsesAPI] add documentation (#30840) · 4c054d89
  Andrew Xia authored Dec 17, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4c054d89
14 Dec, 2025 1 commit

[Doc]: fixing typos in various files (#30540) · 1a55cfaf

Didier Durand authored Dec 14, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a55cfaf

13 Dec, 2025 2 commits
- [Doc] Add documents for multi-node distributed serving with MP backend (#30509) · 7c16f3fb
  Isotr0py authored Dec 14, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7c16f3fb
- [Docs] Clarify Expert Parallel behavior for attention and MoE layers (#30615) · ddbfbe52
  lif authored Dec 14, 2025
```
Signed-off-by: majiayu000 <1835304752@qq.com>
```
  ddbfbe52
11 Dec, 2025 1 commit
- Give pooling examples better names (#30488) · 93db3256
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  93db3256
10 Dec, 2025 1 commit
- [docs] Improve wide-EP performance + benchmarking documentation (#27933) · b9e0951f
  Seiji Eicher authored Dec 10, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  b9e0951f