Skip to content

GitLab

Unverified Commit c3c74bf8 authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

docs: update model support (#760)

parent d9fccfef
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
docs/model_support.md
View file @ c3c74bf8
...@@ -13,3 +13,4 @@ To port a model from vLLM to SGLang, you can compare these two files [SGLang LLa ...@@ -13,3 +13,4 @@ To port a model from vLLM to SGLang, you can compare these two files [SGLang LLa
- Test correctness by comparing the final logits and outputs of the two following commands: - Test correctness by comparing the final logits and outputs of the two following commands:
- `python3 playground/reference_hf.py --model [new model]` - `python3 playground/reference_hf.py --model [new model]`
- `python3 -m sglang.bench_latency --model [new model] --correct --output-len 16 --trust-remote-code` - `python3 -m sglang.bench_latency --model [new model] --correct --output-len 16 --trust-remote-code`
- Update [Supported Models](https://github.com/sgl-project/sglang/tree/main?tab=readme-ov-file#supported-models) at [README](../README.md).
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment