Skip to content

GitLab

Unverified Commit f7c12349 authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

[Fix] Fissertion on YaRN model len (#2984)

parent 57f04494
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
vllm/model_executor/layers/rotary_embedding.py
View file @ f7c12349
...@@ -354,7 +354,6 @@ def get_rope( ...@@ -354,7 +354,6 @@ def get_rope(
elif scaling_type == "yarn": elif scaling_type == "yarn":
original_max_position = rope_scaling[ original_max_position = rope_scaling[
"original_max_position_embeddings"] "original_max_position_embeddings"]
assert max_position == original_max_position * scaling_factor
extra_kwargs = { extra_kwargs = {
k: v k: v
for k, v in rope_scaling.items() for k, v in rope_scaling.items()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment