Commits · 539aa9926007d4896397ca3fa83d48da492b4831 · OpenDAS / vllm_cscc

23 Sep, 2024 1 commit
- [Core] Allow IPv6 in VLLM_HOST_IP with zmq (#8575) · b05f5c92
  Russell Bryant authored Sep 23, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b05f5c92
18 Sep, 2024 1 commit
- [Core] zmq: bind only to 127.0.0.1 for local-only usage (#8543) · d65798f7
  Russell Bryant authored Sep 18, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  d65798f7
17 Sep, 2024 1 commit
- [torch.compile] register allreduce operations as custom ops (#8526) · 99aa4edd
  youkaichao authored Sep 16, 2024
  
  99aa4edd
30 Aug, 2024 1 commit
- [TPU] Support single and multi-host TPUs on GKE (#7613) · 2148441f
  Richard Liu authored Aug 30, 2024
  
  2148441f
26 Aug, 2024 1 commit
- [misc] fix custom allreduce p2p cache file generation (#7853) · 05826c88
  youkaichao authored Aug 26, 2024
  
  05826c88
17 Aug, 2024 2 commits
- [core][misc] update libcudart finding (#7620) · d95cc0a5
  youkaichao authored Aug 16, 2024
```
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  d95cc0a5
- [Bugfix] Fix custom_ar support check (#7617) · e6803499
  bnellnm authored Aug 16, 2024
  
  e6803499
14 Aug, 2024 1 commit
- [Bugfix][CI] Import ray under guard (#7486) · 59edd0f1
  Woosuk Kwon authored Aug 13, 2024
  
  59edd0f1
13 Aug, 2024 1 commit
- [TPU] Support multi-host inference (#7457) · a08df832
  Woosuk Kwon authored Aug 13, 2024
  
  a08df832
07 Aug, 2024 1 commit
- [distributed][misc] add specialized method for cuda platform (#7249) · 639159b2
  youkaichao authored Aug 07, 2024
  
  639159b2
04 Aug, 2024 1 commit
- [misc][distributed] improve libcudart.so finding (#7127) · 16a1cc9b
  youkaichao authored Aug 04, 2024
  
  16a1cc9b
27 Jul, 2024 2 commits
- [TPU] Reduce compilation time & Upgrade PyTorch XLA version (#6856) · fad5576c
  Woosuk Kwon authored Jul 27, 2024
  
  fad5576c
- [TPU] Support collective communications in XLA devices (#6813) · d09b94ca
  Woosuk Kwon authored Jul 26, 2024
  
  d09b94ca
25 Jul, 2024 1 commit
- [core][distributed] fix zmq hang (#6759) · 740374d4
  youkaichao authored Jul 24, 2024
  
  740374d4
21 Jul, 2024 1 commit
- [Misc] Remove abused noqa (#6619) · b6df37f9
  Woosuk Kwon authored Jul 21, 2024
  
  b6df37f9
19 Jul, 2024 1 commit
- [bugfix][distributed] fix multi-node bug for shared memory (#6597) · 07eb6f19
  youkaichao authored Jul 19, 2024
  
  07eb6f19
18 Jul, 2024 1 commit
- [BugFix] Avoid secondary error in ShmRingBuffer destructor (#6530) · d25877dd
  Nick Hill authored Jul 17, 2024
  
  d25877dd
17 Jul, 2024 1 commit
- [misc][distributed] improve tests (#6488) · 7f62077a
  youkaichao authored Jul 16, 2024
  
  7f62077a
16 Jul, 2024 2 commits
- fix import error · 6fa22430
  zhuwenwen authored Jul 16, 2024
  
  6fa22430
- [CI/Build] vLLM cache directory for images (#6444) · d9701151
  Cyrus Leung authored Jul 16, 2024
  
  d9701151
12 Jul, 2024 2 commits
- [distributed][misc] be consistent with pytorch for libcudart.so (#6346) · 2b0fb534
  youkaichao authored Jul 11, 2024
```
[distributed][misc] keep consistent with how pytorch finds libcudart.so (#6346)
```
  2b0fb534
- fix bf16 error · bb73b5a6
  zhuwenwen authored Jul 12, 2024
  
  bb73b5a6
10 Jul, 2024 1 commit
- [core][distributed] zmq fallback for broadcasting large objects (#6183) · da78caec
  youkaichao authored Jul 09, 2024
```
[core][distributed] add zmq fallback for broadcasting large objects (#6183)
```
  da78caec
01 Jul, 2024 1 commit
- [misc][cuda] use nvml to avoid accidentally cuda initialization (#6007) · 614aa512
  youkaichao authored Jun 30, 2024
  
  614aa512
29 Jun, 2024 1 commit
- [CI/Build] Add TP test for vision models (#5892) · 99397da5
  Cyrus Leung authored Jun 29, 2024
  
  99397da5
26 Jun, 2024 1 commit
- [bugfix][distributed] fix shm broadcast when the queue size is full (#5801) · 515080ad
  youkaichao authored Jun 25, 2024
  
  515080ad
25 Jun, 2024 1 commit
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
23 Jun, 2024 1 commit
- [Distributed] Add send and recv helpers (#5719) · 5d4d9053
  Murali Andoorveedu authored Jun 23, 2024
  
  5d4d9053
22 Jun, 2024 1 commit
- [core][distributed] improve shared memory broadcast (#5754) · 832ea88f
  youkaichao authored Jun 22, 2024
  
  832ea88f
21 Jun, 2024 2 commits
- [Core][Distributed] add shm broadcast (#5399) · d9a252bc
  youkaichao authored Jun 20, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  d9a252bc
- [distributed][misc] use fork by default for mp (#5669) · 6c5b7af1
  youkaichao authored Jun 20, 2024
  
  6c5b7af1
18 Jun, 2024 1 commit
- [bugfix][distributed] improve p2p capability test (#5612) · db5ec52a
  youkaichao authored Jun 18, 2024
```
[bugfix][distributed] do not error if two processes do not agree on p2p capability (#5612)
```
  db5ec52a
15 Jun, 2024 1 commit
- [mypy] Enable type checking for test directory (#5017) · 0e9164b4
  Cyrus Leung authored Jun 15, 2024
  
  0e9164b4
14 Jun, 2024 1 commit
- [Core][Distributed] improve p2p cache generation (#5528) · f5bb85b4
  youkaichao authored Jun 14, 2024
  
  f5bb85b4
13 Jun, 2024 2 commits
- Add `cuda_device_count_stateless` (#5473) · 50eed24d
  Antoni Baum authored Jun 13, 2024
  
  50eed24d
- [Core][Distributed] code deduplication in tp&pp with coordinator(#5293) · ea3890a5
  youkaichao authored Jun 12, 2024
```
[Core][Distributed] add coordinator to reduce code duplication in tp and pp (#5293)
```
  ea3890a5
11 Jun, 2024 1 commit
- [Core][Distributed] add same-node detection (#5369) · c4bd03c7
  youkaichao authored Jun 11, 2024
  
  c4bd03c7
10 Jun, 2024 1 commit
- [misc][typo] fix typo (#5372) · c81da5f5
  youkaichao authored Jun 10, 2024
  
  c81da5f5
09 Jun, 2024 1 commit
- [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) · 5467ac31
  bnellnm authored Jun 09, 2024
  
  5467ac31
29 May, 2024 1 commit
- [Core][Distributed] improve p2p access check (#4992) · 594392d2
  youkaichao authored May 29, 2024
  
  594392d2