Commits · 59a0192fb9bef026086d0a2ed32705d870a9466a · OpenDAS / vllm_cscc · GitLab

20 Jan, 2025 1 commit
- [Core] Interface for accessing model from `VllmRunner` (#10353) · 59a0192f
  Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59a0192f
18 Jan, 2025 1 commit
- [misc] fix cross-node TP (#12166) · 2b835032
  youkaichao authored Jan 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2b835032
17 Jan, 2025 1 commit
- [core] allow callable in collective_rpc (#12151) · 87a0c076
  youkaichao authored Jan 17, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  87a0c076
15 Jan, 2025 1 commit
- [core] platform agnostic executor via collective_rpc (#11256) · ad34c0df
  youkaichao authored Jan 15, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ad34c0df
10 Dec, 2024 1 commit
- [V1] Multiprocessing Tensor Parallel Support for v1 (#9856) · 28b3a1c7
  Tyler Michael Smith authored Dec 10, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  28b3a1c7
07 Dec, 2024 1 commit
- [core][executor] simplify instance id (#10976) · 1b62745b
  youkaichao authored Dec 07, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1b62745b
22 Nov, 2024 1 commit
- [platforms] absorb worker cls difference into platforms folder (#10555) · a111d015
  youkaichao authored Nov 21, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  a111d015
08 Nov, 2024 1 commit
- [Misc] Fix ImportError causing by triton (#9493) · 7371749d
  Mengqing Cao authored Nov 08, 2024
  
  7371749d
29 Sep, 2024 1 commit
- [Core] Improve choice of Python multiprocessing method (#8823) · d1537039
  Russell Bryant authored Sep 28, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: youkaichao <youkaichao@126.com>
```
  d1537039
16 Sep, 2024 1 commit
- [BugFix] Fix clean shutdown issues (#8492) · acd5511b
  Nick Hill authored Sep 16, 2024
  
  acd5511b
30 Aug, 2024 1 commit
- [Core] Logprobs support in Multi-step (#7652) · 428dd144
  afeldman-nm authored Aug 29, 2024
  
  428dd144
28 Aug, 2024 1 commit
- [ci][test] fix pp test failure (#7945) · f52a43a8
  youkaichao authored Aug 28, 2024
  
  f52a43a8
27 Aug, 2024 1 commit
- [Hardware][Intel GPU] Add intel GPU pipeline parallel support. (#7810) · 076169f6
  Kunshang Ji authored Aug 28, 2024
  
  076169f6
02 Aug, 2024 1 commit
- [cuda][misc] remove error_on_invalid_device_count_status (#7069) · 660dea12
  youkaichao authored Aug 02, 2024
  
  660dea12
27 Jul, 2024 1 commit

[Bugfix] torch.set_num_threads() in multiproc_gpu_executor (#6802) · 593e79e7

Travis Johnson authored Jul 26, 2024



[Bugfix] Use torch.set_num_threads() to configure parallelism in multiproc_gpu_executor (#6802)
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>

593e79e7

26 Jul, 2024 1 commit
- [Bugfix] [Easy] Fixed a bug in the multiprocessing GPU executor. (#6770) · 084a01fd
  Anthony Platanios authored Jul 26, 2024
  
  084a01fd
20 Jul, 2024 1 commit
- [Core] Allow specifying custom Executor (#6557) · 7bd82002
  Antoni Baum authored Jul 19, 2024
  
  7bd82002
19 Jul, 2024 1 commit
- [Core] Multiprocessing Pipeline Parallel support (#6130) · b5672a11
  Nick Hill authored Jul 18, 2024
```
Co-authored-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  b5672a11
16 Jul, 2024 1 commit
- [ci][distributed] add pipeline parallel correctness test (#6410) · 09c2eb85
  youkaichao authored Jul 16, 2024
  
  09c2eb85
15 Jul, 2024 1 commit
- [Bugfix] Add custom Triton cache manager to resolve MoE MP issue (#6140) · eaec4b91
  Thomas Parnell authored Jul 15, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Chih-Chieh-Yang <chih.chieh.yang@ibm.com>
```
  eaec4b91
03 Jul, 2024 2 commits
- [Bugfix] set OMP_NUM_THREADS to 1 by default for multiprocessing (#6109) · 1dab9bc8
  Travis Johnson authored Jul 03, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  1dab9bc8
- [misc][distributed] error on invalid state (#6092) · f6662071
  youkaichao authored Jul 02, 2024
  
  f6662071
02 Jul, 2024 1 commit
- [Core] Pipeline Parallel Support (#4412) · c5832d2a
  Murali Andoorveedu authored Jul 02, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
```
  c5832d2a
26 Jun, 2024 1 commit

[Core] Refactor Worker and ModelRunner to consolidate control plane communication (#5408) · dda48115

Stephanie Wang authored Jun 25, 2024


Signed-off-by: Stephanie Wang <swang@cs.berkeley.edu>
Signed-off-by: Stephanie <swang@anyscale.com>
Co-authored-by: Stephanie <swang@anyscale.com>

dda48115

25 Jun, 2024 1 commit
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
19 Jun, 2024 1 commit
- [misc][distributed] use 127.0.0.1 for single-node (#5619) · 3eea7488
  youkaichao authored Jun 19, 2024
  
  3eea7488
13 Jun, 2024 1 commit
- Add `cuda_device_count_stateless` (#5473) · 50eed24d
  Antoni Baum authored Jun 13, 2024
  
  50eed24d
11 Jun, 2024 2 commits
- [Core][Doc] Default to multiprocessing for single-node distributed case (#5230) · 99dac099
  Nick Hill authored Jun 11, 2024
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  99dac099
- [Bugfix] Fix `MultiprocessingGPUExecutor.check_health` when world_size == 1 (#5254) · 2e02311a
  Junichi Sato authored Jun 12, 2024
  
  2e02311a
04 Jun, 2024 1 commit
- [Bugfix] Fix torch.compile() error when using MultiprocessingGPUExecutor (#5229) · a58f24e5
  zifeitong authored Jun 03, 2024
  
  a58f24e5
22 May, 2024 1 commit
- [Core] Eliminate parallel worker per-step task scheduling overhead (#4894) · eb6d3c26
  Nick Hill authored May 22, 2024
  
  eb6d3c26
14 May, 2024 1 commit
- [Core] Add MultiprocessingGPUExecutor (#4539) · 676a9998
  Nick Hill authored May 14, 2024
```
Co-authored-by: SAHIL SUNEJA <suneja@us.ibm.com>
```
  676a9998