examples/llm/api_server/chat_vllm.py · 607fac29fadbe47148e1dea73ca49f6fe2243e5d · OpenDAS / dynamo

refactor: openai server skeleton · 607fac29

Neelay Shah authored Jan 22, 2025


Co-authored-by: rmccorm4 <21284872+rmccorm4@users.noreply.github.com>
Co-authored-by: piotrm-nvidia <62554872+piotrm-nvidia@users.noreply.github.com>

607fac29

chat_vllm.py 3.32 KB

Replace chat_vllm.py