Commits · 04e55834254bf11770d544bbeebdbdb7731d9bbd · OpenDAS / vllm_cscc · GitLab

03 Aug, 2024 1 commit
- [ci][distributed] merge distributed test commands (#7097) · 04e55834
  youkaichao authored Aug 02, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  04e55834
02 Aug, 2024 2 commits
- [Core] Pipeline parallel with Ray ADAG (#6837) · 05308891
  Rui Qiao authored Aug 02, 2024
```
Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  05308891
- [ci][distributed] try to fix pp test (#7054) · 25235779
  youkaichao authored Aug 01, 2024
  
  25235779
31 Jul, 2024 2 commits
- [MISC] Introduce pipeline parallelism partition strategies (#6920) · bd700134
  Cody Yu authored Jul 31, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  bd700134
- [Bugfix] Fix broadcasting logic for `multi_modal_kwargs` (#6836) · f230cc2c
  Cyrus Leung authored Jul 31, 2024
  
  f230cc2c
26 Jul, 2024 1 commit
- [ci][distributed] fix flaky tests (#6806) · 443c7cf4
  youkaichao authored Jul 25, 2024
  
  443c7cf4
24 Jul, 2024 1 commit
- [Bugfix] fix flashinfer cudagraph capture for PP (#6708) · 5e8ca973
  William Lin authored Jul 23, 2024
  
  5e8ca973
19 Jul, 2024 1 commit
- [Core] Multiprocessing Pipeline Parallel support (#6130) · b5672a11
  Nick Hill authored Jul 18, 2024
```
Co-authored-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  b5672a11
18 Jul, 2024 2 commits
- [ci][test] add correctness test for cpu offloading (#6549) · f53b8f0d
  youkaichao authored Jul 18, 2024
  
  f53b8f0d
- [Model] Pipeline parallel support for Mixtral (#6516) · b5af8c22
  Cody Yu authored Jul 17, 2024
  
  b5af8c22
17 Jul, 2024 3 commits
- [Bugfix] Fix for multinode crash on 4 PP (#6495) · 5fa6e987
  Murali Andoorveedu authored Jul 17, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  5fa6e987
- [Doc][CI/Build] Update docs and tests to use `vllm serve` (#6431) · 5bf35a91
  Cyrus Leung authored Jul 17, 2024
  
  5bf35a91
- [misc][distributed] improve tests (#6488) · 7f62077a
  youkaichao authored Jul 16, 2024
  
  7f62077a
16 Jul, 2024 1 commit
- [ci][distributed] add pipeline parallel correctness test (#6410) · 09c2eb85
  youkaichao authored Jul 16, 2024
  
  09c2eb85
13 Jul, 2024 1 commit

[ci] try to add multi-node tests (#6280) · 41708e50

youkaichao authored Jul 12, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

41708e50

12 Jul, 2024 1 commit
- [ROCm][AMD] unify CUDA_VISIBLE_DEVICES usage in cuda/rocm (#6352) · b6c16cf8
  Hongxia Yang authored Jul 12, 2024
  
  b6c16cf8
10 Jul, 2024 1 commit
- [core][distributed] zmq fallback for broadcasting large objects (#6183) · da78caec
  youkaichao authored Jul 09, 2024
```
[core][distributed] add zmq fallback for broadcasting large objects (#6183)
```
  da78caec
03 Jul, 2024 2 commits

[vlm] Remove vision language config. (#6089) · d9e98f42

xwjiang2010 authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d9e98f42

[Core] Dynamic image size support for VLMs (#5276) · 9831aec4

Cyrus Leung authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

9831aec4

02 Jul, 2024 1 commit
- [Core] Pipeline Parallel Support (#4412) · c5832d2a
  Murali Andoorveedu authored Jul 02, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  c5832d2a
30 Jun, 2024 2 commits
- [ci][distributed] fix device count call · 2be6955a
  youkaichao authored Jun 30, 2024
```
[ci][distributed] fix some cuda init that makes it necessary to use spawn (#5991)
```
  2be6955a
- [CI/Build] Reuse code for checking output consistency (#5988) · cff6a1fe
  Cyrus Leung authored Jun 30, 2024
  
  cff6a1fe
29 Jun, 2024 1 commit
- [CI/Build] Add TP test for vision models (#5892) · 99397da5
  Cyrus Leung authored Jun 29, 2024
  
  99397da5
28 Jun, 2024 2 commits
- [Kernel] Flashinfer for prefill & decode, with Cudagraph support for decode (#4628) · 7041de43
  Lily Liu authored Jun 28, 2024
```
Co-authored-by: LiuXiaoxuanPKU &lt;llilyliupku@gmail.com&gt;, bong-furiosa <bongwon.jang@furiosa.ai>
```
  7041de43
- [Distributed] Make it clear that % should not be in tensor dict keys. (#5927) · b90d8cd8
  xwjiang2010 authored Jun 28, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
```
  b90d8cd8
27 Jun, 2024 1 commit
- [VLM][Bugfix] Make sure that `multi_modal_kwargs` is broadcasted properly (#5880) · d12af207
  xwjiang2010 authored Jun 27, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
```
  d12af207
26 Jun, 2024 1 commit
- [bugfix][distributed] fix shm broadcast when the queue size is full (#5801) · 515080ad
  youkaichao authored Jun 25, 2024
  
  515080ad
25 Jun, 2024 1 commit
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
23 Jun, 2024 1 commit
- [Distributed] Add send and recv helpers (#5719) · 5d4d9053
  Murali Andoorveedu authored Jun 23, 2024
  
  5d4d9053
21 Jun, 2024 1 commit
- [Core][Distributed] add shm broadcast (#5399) · d9a252bc
  youkaichao authored Jun 20, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  d9a252bc
19 Jun, 2024 1 commit
- [ci][distributed] add tests for custom allreduce (#5689) · d571ca01
  youkaichao authored Jun 19, 2024
  
  d571ca01
15 Jun, 2024 1 commit
- [mypy] Enable type checking for test directory (#5017) · 0e9164b4
  Cyrus Leung authored Jun 15, 2024
  
  0e9164b4
14 Jun, 2024 1 commit
- [mis] fix flaky test of test_cuda_device_count_stateless (#5546) · 48f589e1
  youkaichao authored Jun 14, 2024
  
  48f589e1
13 Jun, 2024 2 commits
- Add `cuda_device_count_stateless` (#5473) · 50eed24d
  Antoni Baum authored Jun 13, 2024
  
  50eed24d
- [Core][Distributed] code deduplication in tp&pp with coordinator(#5293) · ea3890a5
  youkaichao authored Jun 12, 2024
```
[Core][Distributed] add coordinator to reduce code duplication in tp and pp (#5293)
```
  ea3890a5
11 Jun, 2024 1 commit
- [Core][Distributed] add same-node detection (#5369) · c4bd03c7
  youkaichao authored Jun 11, 2024
  
  c4bd03c7
08 Jun, 2024 2 commits
- [CI/Test] improve robustness of test (vllm_runner) (#5357) · 8ea5e44a
  youkaichao authored Jun 08, 2024
```
[CI/Test] improve robustness of test by replacing del with context manager (vllm_runner) (#5357)
```
  8ea5e44a
- [CI/Test] improve robustness of test (hf_runner) (#5347) · 9fb900f9
  youkaichao authored Jun 07, 2024
```
[CI/Test] improve robustness of test by replacing del with context manager (hf_runner) (#5347)
```
  9fb900f9
29 May, 2024 1 commit
- [Core][Optimization] remove vllm-nccl (#5091) · 5bd3c650
  youkaichao authored May 28, 2024
  
  5bd3c650
23 May, 2024 1 commit
- [Core][1/N] Support send/recv in PyNCCL Groups (#4988) · 5eda2ea0
  Murali Andoorveedu authored May 23, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  5eda2ea0