Commits · 64840dfae48621c5c2004eb8f1cb7fba49f9b24e · OpenDAS / vllm_cscc

25 Sep, 2024 3 commits
- [Frontend] MQLLMEngine supports profiling. (#8761) · 64840dfa
  科英 authored Sep 26, 2024
  
  64840dfa
- rename PromptInputs and inputs with backward compatibility (#8760) · 28e1299e
  Cyrus Leung authored Sep 26, 2024
  
  28e1299e
- [Bugfix] Use heartbeats instead of health checks (#8583) · 6e0c9d6b
  Joe Runde authored Sep 24, 2024
  
  6e0c9d6b
24 Sep, 2024 1 commit
- Revert "[Core] Rename `PromptInputs` to `PromptType`, and `inputs` to `prompt`" (#8750) · 3185fb0c
  Simon Mo authored Sep 23, 2024
  
  3185fb0c
23 Sep, 2024 1 commit
- Add output streaming support to multi-step + async while ensuring RequestOutput obj reuse (#8335) · 1a2aef3e
  Alexander Matveev authored Sep 23, 2024
  
  1a2aef3e
21 Sep, 2024 1 commit
- [Core] Rename `PromptInputs` and `inputs`(#8673) · 0057894e
  Cyrus Leung authored Sep 21, 2024
  
  0057894e
19 Sep, 2024 1 commit
- [Frontend] Use MQLLMEngine for embeddings models too (#8584) · 76515f30
  Nick Hill authored Sep 19, 2024
  
  76515f30
18 Sep, 2024 1 commit

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8