Commits · 5bd3c650721cc5de451f034bcbed37d1a1a4116c · OpenDAS / vllm_cscc

29 May, 2024 1 commit
- [Core][Optimization] remove vllm-nccl (#5091) · 5bd3c650
  youkaichao authored May 28, 2024
  
  5bd3c650
23 May, 2024 1 commit
- [Core][1/N] Support send/recv in PyNCCL Groups (#4988) · 5eda2ea0
  Murali Andoorveedu authored May 23, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  5eda2ea0
16 May, 2024 2 commits
- [Core][Distributed] remove graph mode function (#4818) · e0818808
  youkaichao authored May 16, 2024
  
  e0818808
- [Speculative decoding][Re-take] Enable TP>1 speculative decoding (#4840) · 973617ae
  Cody Yu authored May 16, 2024
```
Co-authored-by: Cade Daniel <edacih@gmail.com>
Co-authored-by: Cade Daniel <cade@anyscale.com>
```
  973617ae
13 May, 2024 1 commit
- [Core][Distributed] refactor custom allreduce to support multiple tp groups (#4754) · 702bee46
  youkaichao authored May 12, 2024
  
  702bee46
10 May, 2024 2 commits
- [Core][Test] fix function name typo in custom allreduce (#4750) · 4e121310
  youkaichao authored May 10, 2024
  
  4e121310
- [Core][Distributed] refactor pynccl (#4591) · 208b71bc
  youkaichao authored May 09, 2024
```
[Core][Distributed] refactor pynccl to hold multiple communicators (#4591)
```
  208b71bc
08 May, 2024 1 commit
- [Core][Distributed] support cpu&device in broadcast tensor dict (#4660) · cc466a32
  youkaichao authored May 07, 2024
```
[Core][Distributed] support both cpu and device tensor in broadcast tensor dict (#4660)
```
  cc466a32
07 May, 2024 1 commit
- [Core][Optimization] change python dict to pytorch tensor (#4607) · 63575bc2
  youkaichao authored May 06, 2024
  
  63575bc2
03 May, 2024 1 commit
- [Core][Distributed] enable allreduce for multiple tp groups (#4566) · 344a5d0c
  youkaichao authored May 02, 2024
  
  344a5d0c
02 May, 2024 2 commits
- [Misc] centralize all usage of environment variables (#4548) · 5b8a7c1c
  youkaichao authored May 02, 2024
  
  5b8a7c1c
- [Core][Distributed] enable multiple tp group (#4512) · 2a85f930
  youkaichao authored May 01, 2024
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  2a85f930
01 May, 2024 1 commit
- [Core][Distributed] fix pynccl del error (#4508) · 6ef09b08
  youkaichao authored May 01, 2024
  
  6ef09b08
29 Apr, 2024 1 commit
- [Core][Distributed] use cpu group to broadcast metadata in cpu (#4444) · f4f921b7
  youkaichao authored Apr 29, 2024
  
  f4f921b7
26 Apr, 2024 1 commit
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
24 Apr, 2024 2 commits
- [Core][Distributed] use existing torch.cuda.device (#4318) · 3cd9b5bb
  youkaichao authored Apr 24, 2024
```
[Core][Distributed] use existing torch.cuda.device context manager (#4318)
```
  3cd9b5bb
- [Core][Distributed] use cpu/gloo to initialize pynccl (#4248) · 91f50a6f
  youkaichao authored Apr 23, 2024
  
  91f50a6f
23 Apr, 2024 1 commit
- [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) · 0ae11f78
  SangBin Cho authored Apr 23, 2024
  
  0ae11f78
22 Apr, 2024 1 commit
- [Core][Distributed] fix _is_full_nvlink detection (#4233) · 747b1a71
  youkaichao authored Apr 21, 2024
  
  747b1a71
18 Apr, 2024 2 commits
- [Bugfix] Fix CustomAllreduce nvlink topology detection (#3974) · 8f9c28fd
  Adam Tilghman authored Apr 18, 2024
```
[Bugfix] Fix CustomAllreduce pcie nvlink topology detection (#3974) (#4159)
```
  8f9c28fd
- [Core] nccl integrity check and test (#4155) · 6dc1fc9c
  youkaichao authored Apr 17, 2024
```
[Core] Add integrity check during initialization; add test for it (#4155)
```
  6dc1fc9c
14 Apr, 2024 1 commit
- [Core] avoid too many cuda context by caching p2p test (#4021) · 2cd6b4f3
  youkaichao authored Apr 13, 2024
  
  2cd6b4f3
13 Apr, 2024 1 commit
- [Core][Distributed] improve logging for init dist (#4042) · 98afde19
  youkaichao authored Apr 13, 2024
  
  98afde19
12 Apr, 2024 1 commit
- [mypy] Add mypy type annotation part 1 (#4006) · 09473ee4
  SangBin Cho authored Apr 13, 2024
  
  09473ee4
11 Apr, 2024 2 commits
- [Core] init_distributed_environment align with init_process_group(#4014) · 559eb852
  youkaichao authored Apr 11, 2024
```
[Core][Distributed] make init_distributed_environment compatible with init_process_group (#4014)
```
  559eb852
- [Core][5/N] Fully working chunked prefill e2e (#3884) · 67b4221a
  SangBin Cho authored Apr 11, 2024
  
  67b4221a
10 Apr, 2024 1 commit

[Core][Refactor] move parallel_utils into vllm/distributed (#3950) · 63e7176f

youkaichao authored Apr 10, 2024

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

63e7176f