Commit 700c8597 authored by dengjb's avatar dengjb
Browse files

update

parent 0c3bcea9
......@@ -66,7 +66,7 @@ pip install pycountry
## serve启动
vllm serve moonshotai/Kimi-K2.6 \
-tp 16 \
-tp 8 \
--distributed-executor-backend ray \
--gpu-memory-utilization 0.95 \
--mm-encoder-tp-mode data \
......@@ -175,6 +175,7 @@ DCU与GPU精度一致,推理框架:vllm。
| 模型名称 | 权重大小 | DCU型号 | 最低卡数需求 | 下载地址 |
|:------:|:----:|:----------:|:------:|:---------------------:|
| Kimi-K2.6 | 1.1T | BW1000 | 16 | [Hugging Face](https://huggingface.co/moonshotai/Kimi-K2.6) |
| Kimi-K2.6 | 1.1T | BW1100 | 8 | [Hugging Face](https://huggingface.co/moonshotai/Kimi-K2.6) |
## 源码仓库及问题反馈
- https://developer.sourcefind.cn/codes/modelzoo/kimi-k2.6
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment