Commit 799a5017 authored by chenych's avatar chenych
Browse files

Add deepseek-v3.2-exp

parent 1e5cf81d
......@@ -69,7 +69,7 @@ python fp8_cast_bf16.py --input-fp8-hf-path /path/to/DeepSeek-V3.2-Exp --output-
```bash
python convert.py --hf-ckpt-path /path/to/DeepSeek-V3.2-Exp-bf16 --save-path /path/to/DeepSeek-V3.2-Demo --n-experts 256 --model-parallel 32
```
> 注意:需要将/path/to/fp8_weights中的json文件复制到/path/to/DeepSeek-V3.2-Demo中。
> 注意:需要将/path/to/DeepSeek-V3.2-Exp中的json文件复制到/path/to/DeepSeek-V3.2-Demo中。
3. 启动推理
```bash
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment