Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
611ae88f
Commit
611ae88f
authored
Jan 27, 2025
by
Baber
Browse files
fix
parent
f70ec454
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
lm_eval/models/rwkvwrapper.py
lm_eval/models/rwkvwrapper.py
+3
-1
No files found.
lm_eval/models/rwkvwrapper.py
View file @
611ae88f
...
...
@@ -80,7 +80,7 @@ class RWKVWRAPPER(HFLM):
)
return
path
f
or
pretrained
in
[
i
f
pretrained
in
[
"RWKV-x070-Pile-168M-20241120-ctx4096"
,
"RWKV-x070-Pile-421M-20241127-ctx4096"
,
"RWKV-x070-Pile-1.47B-20241210-ctx4096"
,
...
...
@@ -90,6 +90,8 @@ class RWKVWRAPPER(HFLM):
filename
=
pretrained
+
".pth"
,
local_dir
=
"rwkv_model"
,
)
else
:
raise
ValueError
(
f
"pretrained model
{
pretrained
}
not found"
)
self
.
_model
=
RWKV
(
model
=
f
"rwkv_model/
{
pretrained
}
"
,
strategy
=
"cuda fp16"
)
self
.
_model
.
tie_weights
=
lambda
:
None
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment