Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
f8c688d7
Unverified
Commit
f8c688d7
authored
Dec 17, 2023
by
Woosuk Kwon
Committed by
GitHub
Dec 17, 2023
Browse files
[Minor] Add Phi 2 to supported models (#2159)
parent
c9fadda5
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
5 additions
and
5 deletions
+5
-5
README.md
README.md
+1
-1
docs/source/models/supported_models.rst
docs/source/models/supported_models.rst
+2
-2
tests/models/test_models.py
tests/models/test_models.py
+2
-2
No files found.
README.md
View file @
f8c688d7
...
@@ -65,7 +65,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
...
@@ -65,7 +65,7 @@ vLLM seamlessly supports many Hugging Face models, including the following archi
-
Mixtral (
`mistralai/Mixtral-8x7B-v0.1`
,
`mistralai/Mixtral-8x7B-Instruct-v0.1`
, etc.)
-
Mixtral (
`mistralai/Mixtral-8x7B-v0.1`
,
`mistralai/Mixtral-8x7B-Instruct-v0.1`
, etc.)
-
MPT (
`mosaicml/mpt-7b`
,
`mosaicml/mpt-30b`
, etc.)
-
MPT (
`mosaicml/mpt-7b`
,
`mosaicml/mpt-30b`
, etc.)
-
OPT (
`facebook/opt-66b`
,
`facebook/opt-iml-max-30b`
, etc.)
-
OPT (
`facebook/opt-66b`
,
`facebook/opt-iml-max-30b`
, etc.)
-
Phi
-1.5
(
`microsoft/phi-1_5`
, etc.)
-
Phi (
`microsoft/phi-1_5`
,
`microsoft/phi-2`
,
etc.)
-
Qwen (
`Qwen/Qwen-7B`
,
`Qwen/Qwen-7B-Chat`
, etc.)
-
Qwen (
`Qwen/Qwen-7B`
,
`Qwen/Qwen-7B-Chat`
, etc.)
-
Yi (
`01-ai/Yi-6B`
,
`01-ai/Yi-34B`
, etc.)
-
Yi (
`01-ai/Yi-6B`
,
`01-ai/Yi-34B`
, etc.)
...
...
docs/source/models/supported_models.rst
View file @
f8c688d7
...
@@ -60,8 +60,8 @@ Alongside each architecture, we include some popular models that use it.
...
@@ -60,8 +60,8 @@ Alongside each architecture, we include some popular models that use it.
- OPT, OPT-IML
- OPT, OPT-IML
- :code:`facebook/opt-66b`, :code:`facebook/opt-iml-max-30b`, etc.
- :code:`facebook/opt-66b`, :code:`facebook/opt-iml-max-30b`, etc.
* - :code:`PhiForCausalLM`
* - :code:`PhiForCausalLM`
- Phi
-1.5
- Phi
- :code:`microsoft/phi-1_5`, etc.
- :code:`microsoft/phi-1_5`,
:code:`microsoft/phi-2`,
etc.
* - :code:`QWenLMHeadModel`
* - :code:`QWenLMHeadModel`
- Qwen
- Qwen
- :code:`Qwen/Qwen-7B`, :code:`Qwen/Qwen-7B-Chat`, etc.
- :code:`Qwen/Qwen-7B`, :code:`Qwen/Qwen-7B-Chat`, etc.
...
...
tests/models/test_models.py
View file @
f8c688d7
...
@@ -15,12 +15,12 @@ MODELS = [
...
@@ -15,12 +15,12 @@ MODELS = [
"EleutherAI/pythia-70m"
,
"EleutherAI/pythia-70m"
,
"bigscience/bloom-560m"
,
"bigscience/bloom-560m"
,
"mosaicml/mpt-7b"
,
"mosaicml/mpt-7b"
,
"microsoft/phi-
1_5
"
,
"microsoft/phi-
2
"
,
]
]
@
pytest
.
mark
.
parametrize
(
"model"
,
MODELS
)
@
pytest
.
mark
.
parametrize
(
"model"
,
MODELS
)
@
pytest
.
mark
.
parametrize
(
"dtype"
,
[
"
half
"
])
@
pytest
.
mark
.
parametrize
(
"dtype"
,
[
"
float
"
])
@
pytest
.
mark
.
parametrize
(
"max_tokens"
,
[
128
])
@
pytest
.
mark
.
parametrize
(
"max_tokens"
,
[
128
])
def
test_models
(
def
test_models
(
hf_runner
,
hf_runner
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment