Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
f7389f47
"...text-generation-inference.git" did not exist on "1da642bd0e6de28ef499f17cd226264f3ccdc824"
Unverified
Commit
f7389f47
authored
Aug 02, 2023
by
Zhuohan Li
Committed by
GitHub
Aug 02, 2023
Browse files
[Doc] Add Baichuan 13B to supported models (#656)
parent
55fe8a81
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
5 additions
and
4 deletions
+5
-4
README.md
README.md
+1
-1
docs/source/models/supported_models.rst
docs/source/models/supported_models.rst
+2
-2
vllm/model_executor/models/__init__.py
vllm/model_executor/models/__init__.py
+2
-1
No files found.
README.md
View file @
f7389f47
...
@@ -42,7 +42,7 @@ vLLM is flexible and easy to use with:
...
@@ -42,7 +42,7 @@ vLLM is flexible and easy to use with:
vLLM seamlessly supports many Huggingface models, including the following architectures:
vLLM seamlessly supports many Huggingface models, including the following architectures:
-
Baichuan
-7B (
`baichuan-inc/Baichuan-
7B`
)
-
Baichuan
(
`baichuan-inc/Baichuan-7B`
,
`baichuan-inc/Baichuan-
13B-Chat`
, etc.
)
-
BLOOM (
`bigscience/bloom`
,
`bigscience/bloomz`
, etc.)
-
BLOOM (
`bigscience/bloom`
,
`bigscience/bloomz`
, etc.)
-
Falcon (
`tiiuae/falcon-7b`
,
`tiiuae/falcon-40b`
,
`tiiuae/falcon-rw-7b`
, etc.)
-
Falcon (
`tiiuae/falcon-7b`
,
`tiiuae/falcon-40b`
,
`tiiuae/falcon-rw-7b`
, etc.)
-
GPT-2 (
`gpt2`
,
`gpt2-xl`
, etc.)
-
GPT-2 (
`gpt2`
,
`gpt2-xl`
, etc.)
...
...
docs/source/models/supported_models.rst
View file @
f7389f47
...
@@ -15,8 +15,8 @@ Alongside each architecture, we include some popular models that use it.
...
@@ -15,8 +15,8 @@ Alongside each architecture, we include some popular models that use it.
- Models
- Models
- Example HuggingFace Models
- Example HuggingFace Models
* - :code:`BaiChuanForCausalLM`
* - :code:`BaiChuanForCausalLM`
- Baichuan
-7B
- Baichuan
- :code:`baichuan-inc/Baichuan-7B`.
- :code:`baichuan-inc/Baichuan-7B`
, `baichuan-inc/Baichuan-13B-Chat`, etc
.
* - :code:`BloomForCausalLM`
* - :code:`BloomForCausalLM`
- BLOOM, BLOOMZ, BLOOMChat
- BLOOM, BLOOMZ, BLOOMChat
- :code:`bigscience/bloom`, :code:`bigscience/bloomz`, etc.
- :code:`bigscience/bloom`, :code:`bigscience/bloomz`, etc.
...
...
vllm/model_executor/models/__init__.py
View file @
f7389f47
from
vllm.model_executor.models.baichuan
import
BaiChuanForCausalLM
,
BaichuanForCausalLM
from
vllm.model_executor.models.baichuan
import
(
BaiChuanForCausalLM
,
BaichuanForCausalLM
)
from
vllm.model_executor.models.bloom
import
BloomForCausalLM
from
vllm.model_executor.models.bloom
import
BloomForCausalLM
from
vllm.model_executor.models.falcon
import
FalconForCausalLM
from
vllm.model_executor.models.falcon
import
FalconForCausalLM
from
vllm.model_executor.models.gpt2
import
GPT2LMHeadModel
from
vllm.model_executor.models.gpt2
import
GPT2LMHeadModel
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment