Commits · b9e12416e56a1b2da86bbb7612b8789790a2b645 · OpenDAS / vllm_cscc

29 May, 2024 2 commits
- [Core][Distributed] improve p2p access check (#4992) · 594392d2
  youkaichao authored May 29, 2024
  
  594392d2
- [Core][Optimization] remove vllm-nccl (#5091) · 5bd3c650
  youkaichao authored May 28, 2024
  
  5bd3c650
23 May, 2024 1 commit
- [Core][1/N] Support send/recv in PyNCCL Groups (#4988) · 5eda2ea0
  Murali Andoorveedu authored May 23, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  5eda2ea0
13 May, 2024 1 commit
- [Core][Distributed] refactor custom allreduce to support multiple tp groups (#4754) · 702bee46
  youkaichao authored May 12, 2024
  
  702bee46
10 May, 2024 2 commits
- [Core][Test] fix function name typo in custom allreduce (#4750) · 4e121310
  youkaichao authored May 10, 2024
  
  4e121310
- [Core][Distributed] refactor pynccl (#4591) · 208b71bc
  youkaichao authored May 09, 2024
```
[Core][Distributed] refactor pynccl to hold multiple communicators (#4591)
```
  208b71bc
02 May, 2024 2 commits
- [Misc] centralize all usage of environment variables (#4548) · 5b8a7c1c
  youkaichao authored May 02, 2024
  
  5b8a7c1c
- [Core][Distributed] enable multiple tp group (#4512) · 2a85f930
  youkaichao authored May 01, 2024
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  2a85f930
01 May, 2024 1 commit
- [Core][Distributed] fix pynccl del error (#4508) · 6ef09b08
  youkaichao authored May 01, 2024
  
  6ef09b08
26 Apr, 2024 1 commit
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
24 Apr, 2024 2 commits
- [Core][Distributed] use existing torch.cuda.device (#4318) · 3cd9b5bb
  youkaichao authored Apr 24, 2024
```
[Core][Distributed] use existing torch.cuda.device context manager (#4318)
```
  3cd9b5bb
- [Core][Distributed] use cpu/gloo to initialize pynccl (#4248) · 91f50a6f
  youkaichao authored Apr 23, 2024
  
  91f50a6f
23 Apr, 2024 1 commit
- [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) · 0ae11f78
  SangBin Cho authored Apr 23, 2024
  
  0ae11f78
22 Apr, 2024 1 commit
- [Core][Distributed] fix _is_full_nvlink detection (#4233) · 747b1a71
  youkaichao authored Apr 21, 2024
  
  747b1a71
18 Apr, 2024 2 commits
- [Bugfix] Fix CustomAllreduce nvlink topology detection (#3974) · 8f9c28fd
  Adam Tilghman authored Apr 18, 2024
```
[Bugfix] Fix CustomAllreduce pcie nvlink topology detection (#3974) (#4159)
```
  8f9c28fd
- [Core] nccl integrity check and test (#4155) · 6dc1fc9c
  youkaichao authored Apr 17, 2024
```
[Core] Add integrity check during initialization; add test for it (#4155)
```
  6dc1fc9c
14 Apr, 2024 1 commit
- [Core] avoid too many cuda context by caching p2p test (#4021) · 2cd6b4f3
  youkaichao authored Apr 13, 2024
  
  2cd6b4f3
10 Apr, 2024 1 commit

[Core][Refactor] move parallel_utils into vllm/distributed (#3950) · 63e7176f

youkaichao authored Apr 10, 2024

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

63e7176f