vllm/distributed/device_communicators/shm_broadcast.py · 28b3a1c7e596c08efac0fcfa59a629d16197be30 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Multiprocessing Tensor Parallel Support for v1 (#9856) · 28b3a1c7
Tyler Michael Smith authored Dec 10, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
28b3a1c7

shm_broadcast.py 21.6 KB