Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
f7c12349
Unverified
Commit
f7c12349
authored
Feb 23, 2024
by
Woosuk Kwon
Committed by
GitHub
Feb 23, 2024
Browse files
[Fix] Fissertion on YaRN model len (#2984)
parent
57f04494
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
1 deletion
+0
-1
vllm/model_executor/layers/rotary_embedding.py
vllm/model_executor/layers/rotary_embedding.py
+0
-1
No files found.
vllm/model_executor/layers/rotary_embedding.py
View file @
f7c12349
...
...
@@ -354,7 +354,6 @@ def get_rope(
elif
scaling_type
==
"yarn"
:
original_max_position
=
rope_scaling
[
"original_max_position_embeddings"
]
assert
max_position
==
original_max_position
*
scaling_factor
extra_kwargs
=
{
k
:
v
for
k
,
v
in
rope_scaling
.
items
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment