vllm/entrypoints/openai/api_server.py · 0bd2a573a5a88b6e6135145c5ef5abe3ac942f83 · kecinstone / 2024pra-vllm

Allow send list of str for the Prompt on openai demo endpoint /v1/completions (#323) · 0bd2a573

Michele Catalano authored Jul 03, 2023



* allow str or List[str] for prompt

* Update vllm/entrypoints/openai/api_server.py
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

0bd2a573

api_server.py 21 KB

Replace api_server.py