Skip to content

GitLab

"scripts/README.rst" did not exist on "e17f5ea2d322f5eb3cb7cb14aab9849fba013c7c"
Unverified Commit ca4f1ab8 authored by Ying Sheng's avatar Ying Sheng Committed by GitHub
Browse files

Update model support in readme (#370)

parent 2b6d9991
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 1 deletion
README.md
View file @ ca4f1ab8
...@@ -378,7 +378,12 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port ...@@ -378,7 +378,12 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
- `python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.6-34b --tokenizer-path liuhaotian/llava-v1.6-34b-tokenizer --port 3000` - `python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.6-34b --tokenizer-path liuhaotian/llava-v1.6-34b-tokenizer --port 3000`
- Yi-VL - Yi-VL
- see [srt_example_yi_vl.py](examples/quick_start/srt_example_yi_vl.py). - see [srt_example_yi_vl.py](examples/quick_start/srt_example_yi_vl.py).
- AWQ/GPTQ quantization - StableLM
- Command-R
- DBRX
- AWQ/GPTQ/Marlin quantization
Instructions for supporting a new model are [here](https://github.com/sgl-project/sglang/blob/main/docs/model_support.md).
## Benchmark And Performance ## Benchmark And Performance
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment