vllm/entrypoints/openai/serving_chat.py · fcfc474d449af116f217d4aa2dbd9cea37fa3e55 · OpenDAS / vllm_cscc

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a

serving_chat.py 55.5 KB

Replace serving_chat.py