Skip to content

GitLab

You need to sign in or sign up before continuing.
Closed
Created by ncic_liuyao@ncic_liuyao

vllm能否适配最新版本，为了能支持推理llama3

vllm的dcu支持到0.3.3 vllm github官方最新版本是0.5.0 vllm从0.4.1开始支持llama3

原因：肯定要去测最新的Llama3模型，测Llama2只是做个验证