Skip to content

GitLab

"vllm/entrypoints/openai/engine/serving.py" did not exist on "038e9be4eb7a63189c8980845d80cb96957b9919"
Switch branch/tag
Find file Normal viewHistoryPermalink
test_config_with_model.yaml 192 Bytes
Newer Older
Wei Zeng's avatar
[Feature] specify model in config.yaml (#14855)  
Wei Zeng committed
1
2 
# Same as test_config.yaml but with model specified
model: config-model
Kaunil Dhruv's avatar
[Frontend]-config-cli-args (#7737)  
Kaunil Dhruv committed
3 
port: 12312
Andy Dai's avatar
[Bugfix] Fix order of arguments matters in config.yaml (#8960)  
Andy Dai committed
4 
served_model_name: mymodel
Kaunil Dhruv's avatar
[Frontend]-config-cli-args (#7737)  
Kaunil Dhruv committed
5 
tensor_parallel_size: 2
madt2709's avatar
[Bugfix] Fix load config when using bools (#9533)  
madt2709 committed
6
7 
trust_remote_code: true
multi_step_stream_outputs: false