Commit a8145268 authored by zhuwenwen's avatar zhuwenwen
Browse files

update readme

parent 0211193c
...@@ -24,6 +24,7 @@ SwiGLU 激活函数 [PaLM]。使用 SwiGLU 激活函数替换 ReLU 非线性以 ...@@ -24,6 +24,7 @@ SwiGLU 激活函数 [PaLM]。使用 SwiGLU 激活函数替换 ReLU 非线性以
### 编译 ### 编译
``` ```
source /opt/dtk23.04/env.sh
mkdir build mkdir build
cd build cd build
cmake -DSM=70 -DCMAKE_BUILD_TYPE=Release -DBUILD_MULTI_GPU=ON -DCMAKE_CXX_COMPILER=nvcc .. cmake -DSM=70 -DCMAKE_BUILD_TYPE=Release -DBUILD_MULTI_GPU=ON -DCMAKE_CXX_COMPILER=nvcc ..
...@@ -116,4 +117,4 @@ vocab_size=vocab_size ...@@ -116,4 +117,4 @@ vocab_size=vocab_size
* https://developer.hpccube.com/codes/modelzoo/llama_ft * https://developer.hpccube.com/codes/modelzoo/llama_ft
## 参考 ## 参考
* [https://github.com/NVIDIA/FasterTransformer/](https://github.com/NVIDIA/FasterTransformer/) * [https://github.com/NVIDIA/FasterTransformer](https://github.com/NVIDIA/FasterTransformer)
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment