Commits · b9e0951f964e1b8adfebb973c30462c0e0417c1f · OpenDAS / vllm_cscc

10 Dec, 2025 2 commits
- [docs] Improve wide-EP performance + benchmarking documentation (#27933) · b9e0951f
  Seiji Eicher authored Dec 10, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  b9e0951f
- [Docs] Update EPLB docs (#30426) · fcb89422
  Michael Goin authored Dec 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  fcb89422
02 Dec, 2025 1 commit

[examples] Resettle pooling examples. (#29365) · 2eb4fe91

wang.yuqi authored Dec 02, 2025

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2eb4fe91

01 Dec, 2025 2 commits
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
- [Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
  wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  62de4f42
25 Nov, 2025 1 commit
- [Frontend] Respect Chat Completion parallel_tool_calls param (#26233) · e1dd706c
  Ben Browning authored Nov 25, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e1dd706c
23 Nov, 2025 1 commit
- docs: fixes distributed executor backend config for multi-node vllm (#29173) · 3ed767ec
  Michael Act authored Nov 23, 2025
```
Signed-off-by: Michael Act <michael.a.c.tulenan@gdplabs.id>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  3ed767ec
18 Nov, 2025 1 commit

[chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78

Kevin H. Luu authored Nov 18, 2025


Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c64c0b78

11 Nov, 2025 1 commit
- [Doc] Fix typo in serving docs (#28474) · 287bbbeb
  the-codeboy authored Nov 11, 2025
```
Signed-off-by: the-codeboy <71213855+the-codeboy@users.noreply.github.com>
```
  287bbbeb
30 Oct, 2025 1 commit

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

17 Oct, 2025 3 commits

[Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367) · b038d9c4

Patrick von Platen authored Oct 17, 2025

Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

b038d9c4

[Docs] Replace all explicit anchors with real links (#27087) · 483ea646
Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
483ea646
[Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4ffd6e89

15 Oct, 2025 2 commits
- [doc] add Context Parallel Deployment doc (#26877) · 650b51f9
  youkaichao authored Oct 15, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  650b51f9
- [Doc] ruff format remaining Python examples (#26795) · 62566979
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  62566979
14 Oct, 2025 1 commit
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
08 Oct, 2025 1 commit
- [NIXL][non-cuda] Add install script for nixl with non-cuda ucx (#25959) · 9fc983c7
  Chendi.Xue authored Oct 08, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  9fc983c7
30 Sep, 2025 1 commit
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
27 Sep, 2025 1 commit
- [docs] transcriptions API audio upload (#25446) · ecb37e27
  yyzxw authored Sep 27, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  ecb37e27
24 Sep, 2025 1 commit

[docs] fix nixl kv_connector_extra_config.backends key (#25565) · b1068903

Peter Pan authored Sep 24, 2025

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b1068903

23 Sep, 2025 1 commit
- [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) · 5774b0a1
  Chendi.Xue authored Sep 22, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  5774b0a1
18 Sep, 2025 2 commits
- [Docs] Fix pooling-params doc references in openai_compatible_server.md (#24939) · eaffe448
  Kay Yan authored Sep 18, 2025
  
  eaffe448
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
17 Sep, 2025 1 commit

Removes source compilation of nixl dependency (#24874) · 64ad5518

Benjamin Bartels authored Sep 17, 2025

Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Daniele <36171005+dtrifiro@users.noreply.github.com>

64ad5518

15 Sep, 2025 1 commit

[Misc] Fix examples openai_pooling_client.py (#24853) · bf214ca2

wang.yuqi authored Sep 15, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf214ca2

11 Sep, 2025 1 commit
- [Docs] Fix typos in EP deployment doc (#24669) · 51d41265
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51d41265
10 Sep, 2025 1 commit
- [Docs] Document the extra memory footprint overhead when using EPLB (#24537) · 8b83b937
  Tyler Michael Smith authored Sep 10, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8b83b937
08 Sep, 2025 2 commits

[Docs]add eplb_config param use docs (#24213) · c44797a4
rongfu.leng authored Sep 09, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
c44797a4

[Doc]: fix 2 hyperlinks leading to Ray site after they changed Ray's doc structure (#24438) · 55be93ba

Didier Durand authored Sep 08, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

55be93ba

08 Aug, 2025 1 commit
- [Docs] Rename “Distributed inference and serving” to “Parallelism & Scaling” (#22466) · e2905940
  Ricardo Decal authored Aug 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  e2905940
07 Aug, 2025 1 commit
- [Docs] Factor out troubleshooting to its own guide; add section for Ray Observability (#21578) · a2c6696b
  Ricardo Decal authored Aug 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  a2c6696b
30 Jul, 2025 2 commits
- [Docs] Expand introduction to Ray in Multi-node deployment section (#21584) · 4cd7fe6c
  Ricardo Decal authored Jul 29, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  4cd7fe6c
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

24 Jul, 2025 4 commits
- [Docs] Add Expert Parallelism Initial Documentation (#21373) · a6c7fb8c
  Simon Mo authored Jul 24, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6c7fb8c
- [Docs][minor] Fix broken gh-file link in distributed serving docs (#21543) · a7272c23
  Ricardo Decal authored Jul 24, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  a7272c23
- [Docs] Rewrite Distributed Inference and Serving guide (#20593) · 68417411
  Ricardo Decal authored Jul 24, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  68417411
- [Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) · 63d92abb
  deven-labovitch authored Jul 23, 2025
```
Signed-off-by: Deven Labovitch <deven@videa.ai>
```
  63d92abb
18 Jul, 2025 1 commit
- [Docs] Add minimal demo of Ray Data API usage (#21080) · c4e3b125
  Ricardo Decal authored Jul 17, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  c4e3b125
15 Jul, 2025 1 commit
- [doc] Add more details for Ray-based DP (#20948) · d9127818
  Rui Qiao authored Jul 15, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  d9127818