Commits · c83310174055bb124ea2197885b652efd59b7a0f · OpenDAS / vllm_cscc

08 May, 2024 1 commit
- [Core][Distributed] support cpu&device in broadcast tensor dict (#4660) · cc466a32
  youkaichao authored May 07, 2024
```
[Core][Distributed] support both cpu and device tensor in broadcast tensor dict (#4660)
```
  cc466a32
07 May, 2024 1 commit
- [Core][Optimization] change python dict to pytorch tensor (#4607) · 63575bc2
  youkaichao authored May 06, 2024
  
  63575bc2
03 May, 2024 1 commit
- [Core][Distributed] enable allreduce for multiple tp groups (#4566) · 344a5d0c
  youkaichao authored May 02, 2024
  
  344a5d0c
02 May, 2024 2 commits
- [Misc] centralize all usage of environment variables (#4548) · 5b8a7c1c
  youkaichao authored May 02, 2024
  
  5b8a7c1c
- [Core][Distributed] enable multiple tp group (#4512) · 2a85f930
  youkaichao authored May 01, 2024
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  2a85f930
01 May, 2024 1 commit
- [Core][Distributed] fix pynccl del error (#4508) · 6ef09b08
  youkaichao authored May 01, 2024
  
  6ef09b08
29 Apr, 2024 1 commit
- [Core][Distributed] use cpu group to broadcast metadata in cpu (#4444) · f4f921b7
  youkaichao authored Apr 29, 2024
  
  f4f921b7
26 Apr, 2024 1 commit
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
24 Apr, 2024 2 commits
- [Core][Distributed] use existing torch.cuda.device (#4318) · 3cd9b5bb
  youkaichao authored Apr 24, 2024
```
[Core][Distributed] use existing torch.cuda.device context manager (#4318)
```
  3cd9b5bb
- [Core][Distributed] use cpu/gloo to initialize pynccl (#4248) · 91f50a6f
  youkaichao authored Apr 23, 2024
  
  91f50a6f
23 Apr, 2024 1 commit
- [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) · 0ae11f78
  SangBin Cho authored Apr 23, 2024
  
  0ae11f78
22 Apr, 2024 1 commit
- [Core][Distributed] fix _is_full_nvlink detection (#4233) · 747b1a71
  youkaichao authored Apr 21, 2024
  
  747b1a71
18 Apr, 2024 2 commits
- [Bugfix] Fix CustomAllreduce nvlink topology detection (#3974) · 8f9c28fd
  Adam Tilghman authored Apr 18, 2024
```
[Bugfix] Fix CustomAllreduce pcie nvlink topology detection (#3974) (#4159)
```
  8f9c28fd
- [Core] nccl integrity check and test (#4155) · 6dc1fc9c
  youkaichao authored Apr 17, 2024
```
[Core] Add integrity check during initialization; add test for it (#4155)
```
  6dc1fc9c
14 Apr, 2024 1 commit
- [Core] avoid too many cuda context by caching p2p test (#4021) · 2cd6b4f3
  youkaichao authored Apr 13, 2024
  
  2cd6b4f3
13 Apr, 2024 1 commit
- [Core][Distributed] improve logging for init dist (#4042) · 98afde19
  youkaichao authored Apr 13, 2024
  
  98afde19
12 Apr, 2024 1 commit
- [mypy] Add mypy type annotation part 1 (#4006) · 09473ee4
  SangBin Cho authored Apr 13, 2024
  
  09473ee4
11 Apr, 2024 2 commits
- [Core] init_distributed_environment align with init_process_group(#4014) · 559eb852
  youkaichao authored Apr 11, 2024
```
[Core][Distributed] make init_distributed_environment compatible with init_process_group (#4014)
```
  559eb852
- [Core][5/N] Fully working chunked prefill e2e (#3884) · 67b4221a
  SangBin Cho authored Apr 11, 2024
  
  67b4221a
10 Apr, 2024 1 commit

[Core][Refactor] move parallel_utils into vllm/distributed (#3950) · 63e7176f

youkaichao authored Apr 10, 2024

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

63e7176f