Commits · 59488cc9b14e87d184dff4533348d83c45a49d02 · OpenDAS / vllm_cscc · GitLab

06 Jun, 2025 1 commit
- fix 修改tbo的线程管理和线程释放方式，减少对其他模块的影响 · 59488cc9
  lizhigong authored Jun 06, 2025
  
  59488cc9
04 Jun, 2025 1 commit
- fix tbo to support pipeline-parallel · 1a906ab9
  lizhigong authored Jun 04, 2025
  
  1a906ab9
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
15 May, 2025 1 commit
- fix qwen3-235b run error and remove update_environment_variables of hip · 3f9af065
  zhuwenwen authored May 15, 2025
  
  3f9af065
09 May, 2025 2 commits
- roll back unused change · 29e922ac
  lizhigong authored May 09, 2025
  
  29e922ac
- rm debug log · 7d224eb2
  lizhigong authored May 08, 2025
  
  7d224eb2
27 Apr, 2025 1 commit
- resolve the issue of requiring HIP_VISIBLEDEVICES to be set in order to run multiple cards · be4348a9
  zhuwenwen authored Apr 27, 2025
  
  be4348a9
25 Apr, 2025 1 commit
- [Misc] Clean up redundant code in uniproc_executor.py (#16762) · 5aa6efb9
  Lifu Huang authored Apr 24, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  5aa6efb9
14 Apr, 2025 1 commit
- support numa bind · e8933c34
  zhuwenwen authored Apr 14, 2025
  
  e8933c34
02 Apr, 2025 1 commit
- [core] Add tags parameter to wake_up() (#15500) · ddb94c26
  Eric Tang authored Apr 02, 2025
```
Signed-off-by: Eric <erictang000@gmail.com>
```
  ddb94c26
01 Apr, 2025 1 commit

[Misc] Use envs.VLLM_USE_RAY_COMPILED_DAG_CHANNEL_TYPE (#15831) · 8dd41d6b

Rui Qiao authored Apr 01, 2025


Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

8dd41d6b

24 Mar, 2025 1 commit
- [Misc] Remove ignore_reinit_error for ray.init() (#15373) · 5797fb97
  Rui Qiao authored Mar 24, 2025
  
  5797fb97
22 Mar, 2025 1 commit
- [Misc] Increase RayDistributedExecutor RAY_CGRAPH_get_timeout (#15301) · 4c69e228
  Rui Qiao authored Mar 21, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  4c69e228
21 Mar, 2025 2 commits
- [Misc] Better RayExecutor and multiprocessing compatibility (#14705) · 5df2da5b
  Cody Yu authored Mar 20, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  5df2da5b
- [V1] Scheduler Refactoring [1/N] - Add Scheduler Interface (#15250) · 0c6f5023
  Woosuk Kwon authored Mar 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  0c6f5023
20 Mar, 2025 1 commit
- Fix env vars for running Ray distributed backend on GKE (#15166) · a8f12a63
  Richard Liu authored Mar 20, 2025
```
Signed-off-by: Richard Liu <ricliu@google.com>
```
  a8f12a63
19 Mar, 2025 1 commit
- [Frontend] Remove custom_cache_manager (#13791) · 374ee287
  Alessandro Sangiorgi authored Mar 19, 2025
```
Signed-off-by: fulvius31 <asangior@redhat.com>
```
  374ee287
12 Mar, 2025 1 commit

[CPU] Upgrade CPU backend to torch-2.6 (#13381) · ff47aab0

Li, Jiang authored Mar 12, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

ff47aab0

08 Mar, 2025 1 commit
- [V1] TPU - Add tensor parallel support via Ray (#13618) · cb8bdfad
  Alexander Matveev authored Mar 08, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  cb8bdfad
06 Mar, 2025 1 commit
- [misc] Mention `ray list nodes` command to troubleshoot ray issues (#14318) · abcc61e0
  Rui Qiao authored Mar 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  abcc61e0
05 Mar, 2025 1 commit
- Small update for external_launcher backend docs (#14288) · 47d4a7e0
  Zhe Zhang authored Mar 05, 2025
  
  47d4a7e0
04 Mar, 2025 1 commit
- [core] Pass all driver env vars to ray workers unless excluded (#14099) · bf13d409
  Rui Qiao authored Mar 03, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  bf13d409
28 Feb, 2025 1 commit
- [core] Bump ray to 2.43 (#13994) · 084bbac8
  Rui Qiao authored Feb 28, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  084bbac8
27 Feb, 2025 2 commits
- [bugfix] Fix profiling for RayDistributedExecutor (#13945) · 06c8f8d8
  Rui Qiao authored Feb 27, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  06c8f8d8
- [misc] Rename Ray ADAG to Compiled Graph (#13928) · c9944acb
  Rui Qiao authored Feb 26, 2025
  
  c9944acb
26 Feb, 2025 2 commits
- [Misc]Code Cleanup (#13859) · e1fe7591
  Chenguang Li authored Feb 26, 2025
```
Signed-off-by: noemotiovon <noemotiovon@gmail.com>
Co-authored-by: noemotiovon <noemotiovon@gmail.com>
```
  e1fe7591
- [misc] Show driver IP info when Ray fails to allocate driver worker (#13858) · 9ba28043
  Rui Qiao authored Feb 25, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  9ba28043
25 Feb, 2025 3 commits
- [Bugfix] Flush TunableOp results before worker processes are destroyed. (#13623) · fa820741
  Nichols A. Romero authored Feb 25, 2025
```
Signed-off-by: Nichols A. Romero <nick.romero@amd.com>
```
  fa820741
- [misc] Clean up ray compiled graph type hints (#13731) · 3173c3b3
  Rui Qiao authored Feb 25, 2025
  
  3173c3b3
- [Misc] set single whitespace between log sentences (#13771) · 51010a18
  cjackal authored Feb 25, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  51010a18
23 Feb, 2025 1 commit
- [v1] torchrun compatibility (#13642) · eb24dc4a
  youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb24dc4a
19 Feb, 2025 1 commit

[MISC] Logging the message about Ray teardown (#13502) · fbbe1fba

Cody Yu authored Feb 19, 2025


Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>

fbbe1fba

17 Feb, 2025 1 commit
- [MISC] tiny fixes (#13378) · 238dfc8a
  Mengqing Cao authored Feb 17, 2025
  
  238dfc8a
14 Feb, 2025 1 commit
- [Misc] Log time consumption of sleep and wake-up (#13115) · 556ef7f7
  Jun Duan authored Feb 14, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  556ef7f7
13 Feb, 2025 1 commit
- [V1][core] Implement pipeline parallel on Ray (#12996) · 9605c125
  Rui Qiao authored Feb 13, 2025
  
  9605c125
11 Feb, 2025 2 commits
- [executor] init `local_rank` as device index (#13027) · 9cf47594
  Mengqing Cao authored Feb 11, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  9cf47594
- [Core] Don't do platform detection at import time (#12933) · c320ca8e
  Russell Bryant authored Feb 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c320ca8e
07 Feb, 2025 1 commit
- Make vllm compatible with verl (#12824) · 433c4a49
  ZSL98 authored Feb 07, 2025
```
Co-authored-by: zhangshulai <zhangshulai@bytedance.com>
```
  433c4a49
05 Feb, 2025 1 commit
- [core][distributed] exact ray placement control (#12732) · bc1bdece
  youkaichao authored Feb 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  bc1bdece
03 Feb, 2025 1 commit

[doc][misc] clarify VLLM_HOST_IP for multi-node inference (#12667) · e6433091

youkaichao authored Feb 03, 2025

As more and more people are trying deepseek models with multi-node
inference, https://github.com/vllm-project/vllm/issues/7815

 becomes more
frequent. Let's give clear message to users.
Signed-off-by: youkaichao <youkaichao@gmail.com>

e6433091