Skip to content

GitLab

"sgl-kernel/python/sgl_kernel/elementwise.py" did not exist on "110e0066735a3bd431c2640ae168fc040d7c0806"
Unverified Commit ba29504b authored by Liangsheng Yin's avatar Liangsheng Yin Committed by GitHub
Browse files

Update supported models (#763)

parent a72342f1
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
README.md
View file @ ba29504b
......@@ -177,6 +177,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-405B-Instr
- Mistral / Mixtral
- Gemma / Gemma 2
- Qwen / Qwen 2 / Qwen 2 MoE
- DeepSeek / DeepSeek 2
- LLaVA 1.5 / 1.6
- `python -m sglang.launch_server --model-path liuhaotian/llava-v1.5-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
- `python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-vicuna-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment