Commits · bae888cb8e01b89ad58e3fdaf14f21c109c5fad7 · OpenDAS / vllm_cscc

17 Aug, 2024 1 commit
- [Bugfix] Clear engine reference in AsyncEngineRPCServer (#7618) · bae888cb
  Rui Qiao authored Aug 16, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  bae888cb
16 Aug, 2024 1 commit
- [Core] Use uvloop with zmq-decoupled front-end (#7570) · 9587b050
  Nick Hill authored Aug 15, 2024
  
  9587b050
13 Aug, 2024 1 commit
- [Core] Shut down aDAG workers with clean async llm engine exit (#7224) · 198d6a28
  Rui Qiao authored Aug 12, 2024
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  198d6a28
08 Aug, 2024 1 commit
- [Frontend] Kill the server on engine death (#6594) · 21b9c49a
  Joe Runde authored Aug 08, 2024
```
Signed-off-by: Joe Runde <joe@joerun.de>
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  21b9c49a
07 Aug, 2024 1 commit
- [ BugFix ] Move `zmq` frontend to IPC instead of TCP (#7222) · 56498572
  Robert Shaw authored Aug 07, 2024
  
  56498572
05 Aug, 2024 1 commit
- [BugFix] Use IP4 localhost form for zmq bind (#7163) · 003f8ee1
  Nick Hill authored Aug 05, 2024
  
  003f8ee1
03 Aug, 2024 1 commit

[ Frontend ] Multiprocessing for OpenAI Server with `zeromq` (#6883) · ed812a73

Robert Shaw authored Aug 02, 2024


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

ed812a73