Unverified Commit ee1df26a authored by Lianmin Zheng's avatar Lianmin Zheng Committed by GitHub
Browse files

Update README.md

parent 3ae78a09
...@@ -368,7 +368,7 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port ...@@ -368,7 +368,7 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
- `python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.5-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000` - `python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.5-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
- Yi-VL - Yi-VL
- see [srt_example_yi_vl.py](examples/quick_start/srt_example_yi_vl.py). - see [srt_example_yi_vl.py](examples/quick_start/srt_example_yi_vl.py).
- AWQ quantization - AWQ/GPTQ quantization
## Benchmark And Performance ## Benchmark And Performance
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment