Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "c4c99c3907c9524dc15e86ddd69389a5ffcdc07d"
Unverified Commit c46eaf70 authored by SeongBeomLEE's avatar SeongBeomLEE Committed by GitHub
Browse files

[fix] Modifying base in yarn embedding (#2212)

parent d789de32
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
server/text_generation_server/layers/rotary.py
View file @ c46eaf70
...@@ -102,7 +102,7 @@ class PositionRotaryEmbedding(nn.Module): ...@@ -102,7 +102,7 @@ class PositionRotaryEmbedding(nn.Module):
max_position_embeddings=rope_scaling[ max_position_embeddings=rope_scaling[
"original_max_position_embeddings" "original_max_position_embeddings"
], ],
base=10000.0, base=base,
device=inv_freq.device, device=inv_freq.device,
scaling_factor=scaling_factor, scaling_factor=scaling_factor,
extrapolation_factor=1, extrapolation_factor=1,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment