llama3_vllm.yaml 142 Bytes
Newer Older
dongchy920's avatar
dongchy920 committed
1
2
3
4
5
model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
template: llama3
infer_backend: vllm
vllm_enforce_eager: true
trust_remote_code: true