"git@developer.sourcefind.cn:kecinstone/2024-pra-vllm.git" did not exist on "d6fa1be3a8ef71fa16f74afdc5d07d27cbf725b1"
Commit 1f11bf8f authored by raojy's avatar raojy 💬
Browse files

Update README.md

parent 7c24d52b
...@@ -14,15 +14,15 @@ Nemotron-3-Super-120B-A12B-BF16 是由英伟达 (NVIDIA) 训练的大语言模 ...@@ -14,15 +14,15 @@ Nemotron-3-Super-120B-A12B-BF16 是由英伟达 (NVIDIA) 训练的大语言模
## 环境依赖 ## 环境依赖
| **软件** | **版本** | | **软件** | **版本** |
| ------------ | ----------------------------------------- | | :----------: | :------------------------------------------------: |
| DTK | 26.04 | | DTK | 26.04 |
| python | 3.10.12 | | python | 3.10.12 |
| transformers | 5.2.0.dev0 | | transformers | 5.2.0.dev0 |
| vllm | 0.15.1+das.opt1.alpha.dtk2604 | | vllm | 0.15.1+das.opt1.alpha.dtk2604 |
| triton | 3.3.0+das.opt2.dtk2604.torch291.20260210.g1329924c | | triton | 3.3.0+das.opt2.dtk2604.torch291.20260210.g1329924c |
| torch | 22.9.0+das.opt1.dtk2604.20260206.g275d08c2 | | torch | 22.9.0+das.opt1.dtk2604.20260206.g275d08c2 |
| numpy | 1.26.1 | | numpy | 1.26.1 |
当前仅支持定制镜像: `harbor.sourcefind.cn:5443/dcu/admin/base/custom:vllm0.15.1-ubuntu22.04-dtk26.04-0130-py3.10-20260220` 当前仅支持定制镜像: `harbor.sourcefind.cn:5443/dcu/admin/base/custom:vllm0.15.1-ubuntu22.04-dtk26.04-0130-py3.10-20260220`
...@@ -116,8 +116,8 @@ DCU 与 GPU 精度一致,推理框架:vllm。 ...@@ -116,8 +116,8 @@ DCU 与 GPU 精度一致,推理框架:vllm。
## 预训练权重 ## 预训练权重
| **模型名称** | **权重大小** | **DCU型号** | **最低卡数需求** | **下载地址** | | **模型名称** | **权重大小** | **DCU型号** | **最低卡数需求** | **下载地址** |
| ------------------------------- | ------------ | ------------- | ---------------- | ------------------------------------------------------------ | | :-----------------------------: | :----------: | :-----------: | :--------------: | :----------------------------------------------------------: |
| Nemotron-3-Super-120B-A12B | 120B | BW1000 | 8 | [Hugging Face](https://www.google.com/search?q=https://huggingface.co/nvidia/nemotron-3-super-120b) | | | Nemotron-3-Super-120B-A12B | 120B | BW1000 | 8 | [Hugging Face](https://www.google.com/search?q=https://huggingface.co/nvidia/nemotron-3-super-120b) |
## 源码仓库及问题反馈 ## 源码仓库及问题反馈
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment