Commit a8145268 authored by zhuwenwen's avatar zhuwenwen
Browse files

update readme

parent 0211193c
......@@ -24,6 +24,7 @@ SwiGLU 激活函数 [PaLM]。使用 SwiGLU 激活函数替换 ReLU 非线性以
### 编译
```
source /opt/dtk23.04/env.sh
mkdir build
cd build
cmake -DSM=70 -DCMAKE_BUILD_TYPE=Release -DBUILD_MULTI_GPU=ON -DCMAKE_CXX_COMPILER=nvcc ..
......@@ -116,4 +117,4 @@ vocab_size=vocab_size
* https://developer.hpccube.com/codes/modelzoo/llama_ft
## 参考
* [https://github.com/NVIDIA/FasterTransformer/](https://github.com/NVIDIA/FasterTransformer/)
\ No newline at end of file
* [https://github.com/NVIDIA/FasterTransformer](https://github.com/NVIDIA/FasterTransformer)
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment