Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
2832e7b9
"projects/git@developer.sourcefind.cn:OpenDAS/pytorch3d.git" did not exist on "9b2e5705368dc1e50782d5a71c956284bcf72c79"
Unverified
Commit
2832e7b9
authored
Jan 25, 2024
by
Junyang Lin
Committed by
GitHub
Jan 24, 2024
Browse files
fix names and license for Qwen2 (#2589)
parent
3a7dd7e3
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
3 deletions
+4
-3
docs/source/models/supported_models.rst
docs/source/models/supported_models.rst
+1
-1
vllm/model_executor/models/qwen2.py
vllm/model_executor/models/qwen2.py
+3
-2
No files found.
docs/source/models/supported_models.rst
View file @
2832e7b9
...
@@ -70,7 +70,7 @@ Alongside each architecture, we include some popular models that use it.
...
@@ -70,7 +70,7 @@ Alongside each architecture, we include some popular models that use it.
- :code:`Qwen/Qwen-7B`, :code:`Qwen/Qwen-7B-Chat`, etc.
- :code:`Qwen/Qwen-7B`, :code:`Qwen/Qwen-7B-Chat`, etc.
* - :code:`Qwen2ForCausalLM`
* - :code:`Qwen2ForCausalLM`
- Qwen2
- Qwen2
- :code:`Qwen/Qwen2-
7B-
beta`, :code:`Qwen/Qwen-7B-Chat
-beta
`, etc.
- :code:`Qwen/Qwen2-beta
-7B
`, :code:`Qwen/Qwen
2-beta
-7B-Chat`, etc.
* - :code:`StableLMEpochForCausalLM`
* - :code:`StableLMEpochForCausalLM`
- StableLM
- StableLM
- :code:`stabilityai/stablelm-3b-4e1t/` , :code:`stabilityai/stablelm-base-alpha-7b-v2`, etc.
- :code:`stabilityai/stablelm-3b-4e1t/` , :code:`stabilityai/stablelm-base-alpha-7b-v2`, etc.
...
...
vllm/model_executor/models/qwen2.py
View file @
2832e7b9
# coding=utf-8
# coding=utf-8
# Adapted from
# Adapted from
# https://github.com/huggingface/transformers/blob/v4.28.0/src/transformers/models/qwen2/modeling_qwen2.py
# https://github.com/huggingface/transformers/blob/v4.28.0/src/transformers/models/qwen2/modeling_qwen2.py
# Copyright 2024 The Qwen team and the HuggingFace Inc. team.
# Copyright 2024 The Qwen team.
# Copyright 2023 The vLLM team.
# Copyright 2022 EleutherAI and the HuggingFace Inc. team. All rights reserved.
# Copyright 2022 EleutherAI and the HuggingFace Inc. team. All rights reserved.
#
#
# This code is based on EleutherAI's GPT-NeoX library and the GPT-NeoX
# This code is based on EleutherAI's GPT-NeoX library and the GPT-NeoX
...
@@ -20,7 +21,7 @@
...
@@ -20,7 +21,7 @@
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# See the License for the specific language governing permissions and
# limitations under the License.
# limitations under the License.
"""Inference-only
Mistral
model compatible with HuggingFace weights."""
"""Inference-only
Qwen2
model compatible with HuggingFace weights."""
from
typing
import
List
,
Optional
,
Tuple
from
typing
import
List
,
Optional
,
Tuple
import
torch
import
torch
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment