Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Mistral_pytorch
Commits
7a1647e3
Commit
7a1647e3
authored
Jun 12, 2025
by
chenych
Browse files
Add train loss
parent
bc137ddf
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
13 additions
and
2 deletions
+13
-2
README.md
README.md
+11
-2
llama-factory/train_full/mistral_full_sft.yaml
llama-factory/train_full/mistral_full_sft.yaml
+1
-0
llama-factory/train_lora/mistral_lora_sft.yaml
llama-factory/train_lora/mistral_lora_sft.yaml
+1
-0
No files found.
README.md
View file @
7a1647e3
...
...
@@ -109,12 +109,21 @@ curl http://<your-node-url>:8000/v1/chat/completions \
```
## result
Prompt: "Explain Machine Learning to me in a nutshell."
<div
align=
center
>
<img
src=
"./doc/results.png
cd ../
"
/>
<img
src=
"./doc/results.png"
/>
</div>
### 精度
DCU与GPU精度一致,推理框架:pytorch。
训练框架:
[
Llama-Factory
](
https://developer.sourcefind.cn/codes/OpenDAS/llama-factory
)
训练脚本:
[
mistral_lora_sft.yaml
](
llama-factory/train_lora/mistral_lora_sft.yaml
)
| device | train_loss |
|:----------:|:-------:|
| DCU K100AI | 0.8139 |
| GPU A800 | 0.497 |
## 应用场景
### 算法类别
...
...
llama-factory/train_full/mistral_full_sft.yaml
View file @
7a1647e3
...
...
@@ -23,6 +23,7 @@ save_steps: 500
plot_loss
:
true
overwrite_output_dir
:
true
save_only_model
:
false
report_to
:
none
# choices: [none, wandb, tensorboard, swanlab, mlflow]
### train
per_device_train_batch_size
:
1
...
...
llama-factory/train_lora/mistral_lora_sft.yaml
View file @
7a1647e3
...
...
@@ -26,6 +26,7 @@ save_steps: 500
plot_loss
:
true
overwrite_output_dir
:
true
save_only_model
:
false
report_to
:
none
# choices: [none, wandb, tensorboard, swanlab, mlflow]
### train
per_device_train_batch_size
:
1
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment