Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
2b4c6462
Unverified
Commit
2b4c6462
authored
Jul 20, 2024
by
Ying Sheng
Committed by
GitHub
Jul 20, 2024
Browse files
Update version to 0.1.22 (#677)
parent
f424e76d
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
6 additions
and
4 deletions
+6
-4
README.md
README.md
+1
-1
examples/usage/llava_video/srt_example_llava_v.py
examples/usage/llava_video/srt_example_llava_v.py
+3
-1
python/pyproject.toml
python/pyproject.toml
+1
-1
python/sglang/__init__.py
python/sglang/__init__.py
+1
-1
No files found.
README.md
View file @
2b4c6462
...
@@ -166,7 +166,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct
...
@@ -166,7 +166,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct
-
`python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-vicuna-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
-
`python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-vicuna-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
-
`python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-34b --tokenizer-path liuhaotian/llava-v1.6-34b-tokenizer --port 30000`
-
`python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-34b --tokenizer-path liuhaotian/llava-v1.6-34b-tokenizer --port 30000`
-
LLaVA-NeXT-Video
-
LLaVA-NeXT-Video
-
see
[
srt_
example
_
llava_v
.sh
](
examples/usage/llava_video
/srt_example_llava_v.sh
)
-
see
[
example
s/usage/
llava_v
ideo
](
examples/usage/llava_video
)
-
Yi-VL
-
Yi-VL
-
see
[
srt_example_yi_vl.py
](
examples/quick_start/srt_example_yi_vl.py
)
.
-
see
[
srt_example_yi_vl.py
](
examples/quick_start/srt_example_yi_vl.py
)
.
-
StableLM
-
StableLM
...
...
examples/usage/llava_video/srt_example_llava_v.py
View file @
2b4c6462
"""
"""
Usage: python3 srt_example_llava.py
Usage:
pip install opencv-python-headless
python3 srt_example_llava.py
"""
"""
import
argparse
import
argparse
...
...
python/pyproject.toml
View file @
2b4c6462
...
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
...
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
[project]
[project]
name
=
"sglang"
name
=
"sglang"
version
=
"0.1.2
1
"
version
=
"0.1.2
2
"
description
=
"SGLang is yet another fast serving framework for large language models and vision language models."
description
=
"SGLang is yet another fast serving framework for large language models and vision language models."
readme
=
"README.md"
readme
=
"README.md"
requires-python
=
">=3.8"
requires-python
=
">=3.8"
...
...
python/sglang/__init__.py
View file @
2b4c6462
__version__
=
"0.1.2
1
"
__version__
=
"0.1.2
2
"
# SGL API Components
# SGL API Components
from
sglang.api
import
(
from
sglang.api
import
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment