vllm/entrypoints/openai/serving_chat.py · a7e3eba66fff82f7e12bb2354c4b26635f0f7761 · OpenDAS / vllm_cscc

[Frontend] Support reasoning content for deepseek r1 (#12473) · a7e3eba6

Ce Gao authored Jan 29, 2025


Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

a7e3eba6

serving_chat.py 42.9 KB

Replace serving_chat.py