llama3_vllm.yaml 115 Bytes
Newer Older
chenzk's avatar
v1.0  
chenzk committed
1
2
3
4
model_name_or_path: meta-llama/Llama-3.2-3B-Instruct
template: llama3
infer_backend: vllm
vllm_enforce_eager: true