Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
a3bbbfa1
Unverified
Commit
a3bbbfa1
authored
Aug 06, 2024
by
Dipika Sikka
Committed by
GitHub
Aug 06, 2024
Browse files
[BugFix] Fix DeepSeek remote code (#7178)
parent
1f26efbb
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
5 additions
and
1 deletion
+5
-1
.buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yaml
...ldkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yaml
+1
-0
.buildkite/lm-eval-harness/test_lm_eval_correctness.py
.buildkite/lm-eval-harness/test_lm_eval_correctness.py
+4
-1
No files found.
.buildkite/lm-eval-harness/configs/DeepSeek-V2-Lite-Chat.yaml
View file @
a3bbbfa1
...
@@ -9,3 +9,4 @@ tasks:
...
@@ -9,3 +9,4 @@ tasks:
value
:
0.664
value
:
0.664
limit
:
1000
limit
:
1000
num_fewshot
:
5
num_fewshot
:
5
trust_remote_code
:
True
\ No newline at end of file
.buildkite/lm-eval-harness/test_lm_eval_correctness.py
View file @
a3bbbfa1
...
@@ -23,9 +23,12 @@ TP_SIZE = os.environ.get("LM_EVAL_TP_SIZE", 1)
...
@@ -23,9 +23,12 @@ TP_SIZE = os.environ.get("LM_EVAL_TP_SIZE", 1)
def
launch_lm_eval
(
eval_config
):
def
launch_lm_eval
(
eval_config
):
trust_remote_code
=
eval_config
.
get
(
'trust_remote_code'
,
False
)
model_args
=
f
"pretrained=
{
eval_config
[
'model_name'
]
}
,"
\
model_args
=
f
"pretrained=
{
eval_config
[
'model_name'
]
}
,"
\
f
"tensor_parallel_size=
{
TP_SIZE
}
,"
\
f
"tensor_parallel_size=
{
TP_SIZE
}
,"
\
f
"add_bos_token=true"
f
"add_bos_token=true,"
\
f
"trust_remote_code=
{
trust_remote_code
}
"
results
=
lm_eval
.
simple_evaluate
(
results
=
lm_eval
.
simple_evaluate
(
model
=
"vllm"
,
model
=
"vllm"
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment