vllm/entrypoints/openai/serving_chat.py · 539aa9926007d4896397ca3fa83d48da492b4831 · OpenDAS / vllm_cscc

"docs/design/prefix_caching.md" did not exist on "0eca5eacd07061c5692250d0ef86267da831bd9f"

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

serving_chat.py 37.4 KB

Replace serving_chat.py