Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
ee1df26a
"tools/utils/files.py" did not exist on "18d89b5df6af24ce2522477d4e94282892078053"
Unverified
Commit
ee1df26a
authored
Feb 06, 2024
by
Lianmin Zheng
Committed by
GitHub
Feb 06, 2024
Browse files
Update README.md
parent
3ae78a09
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
ee1df26a
...
...
@@ -368,7 +368,7 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
-
`python3 -m sglang.launch_server --model-path liuhaotian/llava-v1.5-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
-
Yi-VL
-
see
[
srt_example_yi_vl.py
](
examples/quick_start/srt_example_yi_vl.py
)
.
-
AWQ quantization
-
AWQ
/GPTQ
quantization
## Benchmark And Performance
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment