Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
vllm_serve.sh 195 Bytes
Newer Older
dengjb's avatar
update  
dengjb committed
1
2
3
4
5
6 
vllm serve /home/dengjb/download/ByteDance-Seed/Seed-OSS-36B-Instruct/ \
    --trust-remote-code \
    --max-model-len 32768 \
    --served-model-name seed-oss \
    --dtype bfloat16 \
    -tp 2