examples/llm/api_server/triton_distributed_engine.py · 607fac29fadbe47148e1dea73ca49f6fe2243e5d · OpenDAS / dynamo

refactor: openai server skeleton · 607fac29

Neelay Shah authored Jan 22, 2025


Co-authored-by: rmccorm4 <21284872+rmccorm4@users.noreply.github.com>
Co-authored-by: piotrm-nvidia <62554872+piotrm-nvidia@users.noreply.github.com>

607fac29

triton_distributed_engine.py 4.83 KB

Replace triton_distributed_engine.py