Skip to content

GitLab

Commit 2091e9e6 authored by luopl's avatar luopl
Browse files

Update README.md

parent 98957dd7
Pipeline #1626 canceled with stages
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 2 deletions
README.md
View file @ 2091e9e6
...@@ -144,13 +144,14 @@ ds = MsDataset.load('opencompass/piqa') ...@@ -144,13 +144,14 @@ ds = MsDataset.load('opencompass/piqa')
### 单机单卡 ### 单机单卡
Evaluate： Evaluate：
#To run evaluations on Mamba-1 models
To run evaluations on Mamba-1 models
``` ```
lm_eval --model mamba_ssm --model_args pretrained=state-spaces/mamba-130m --tasks lambada_openai,hellaswag,piqa,arc_easy,arc_challenge,winogrande,openbookqa --device cuda --batch_size 256 lm_eval --model mamba_ssm --model_args pretrained=state-spaces/mamba-130m --tasks lambada_openai,hellaswag,piqa,arc_easy,arc_challenge,winogrande,openbookqa --device cuda --batch_size 256
``` ```
#To run evaluations on Mamba-2 models: To run evaluations on Mamba-2 models:
``` ```
lm_eval --model mamba_ssm --model_args pretrained=state-spaces/mamba2-2.7b --tasks lambada_openai,hellaswag,piqa,arc_easy,arc_challenge,winogrande,openbookqa --device cuda --batch_size 256 lm_eval --model mamba_ssm --model_args pretrained=state-spaces/mamba2-2.7b --tasks lambada_openai,hellaswag,piqa,arc_easy,arc_challenge,winogrande,openbookqa --device cuda --batch_size 256
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment