Commit f691f5f6 authored by ACzhangchao's avatar ACzhangchao
Browse files

Update readme

parent b53c5d8f
# JIUTIAN-139MoE-Chat # JIUTIAN-139MoE-Chat
## 论文
https://www.modelscope.cn/models/JiuTian-AI/JIUTIAN-139MoE-chat/file/view/master?fileName=JIUTIAN-139MOE%2520TECHNICAL%2520REPORT.pdf&status=1
## 模型结构
JIUTIAN-139MoE是一个拥有130亿参数的大型语言模型,使用解码器型的MoE架构,包含一对大专家和六个小专家。模型支持在不同GPU和NPU集群上训练,并能无损切换。在FFN层采用MoE设计,有特殊的激活和路由机制。
![1727158586419](C:\Users\zhang\AppData\Roaming\Typora\typora-user-images\1727158586419.png)
## 算法原理
JIUTIAN-139MoE利用Mixture-of-Experts (MoE) 架构,通过不同规模的专家网络处理不同的数据特征,并通过门控机制智能地分配任务给最合适的专家,从而提高模型处理复杂问题的能力。
## 环境配置 ## 环境配置
### Docker ### Docker
...@@ -19,6 +33,10 @@ cd jiutian-139moe-chat ...@@ -19,6 +33,10 @@ cd jiutian-139moe-chat
下载模型权重:[JIUTIAN-139MoE-Chat · 模型库 (modelscope.cn)](https://www.modelscope.cn/models/jiutian-ai/jiutian-139moe-chat/files) 下载模型权重:[JIUTIAN-139MoE-Chat · 模型库 (modelscope.cn)](https://www.modelscope.cn/models/jiutian-ai/jiutian-139moe-chat/files)
## 数据集
### 模型推理 ### 模型推理
``` ```
...@@ -45,3 +63,20 @@ curl -X POST "http://localhost:8000/predict/" -H "Content-Type: application/json ...@@ -45,3 +63,20 @@ curl -X POST "http://localhost:8000/predict/" -H "Content-Type: application/json
{"response":"Human:\nPlease introduce the Great Wall.\n\nAssistant:\n The Great Wall of China is a series of fortifications built along the northern borders of China to protect against invasions and raids from various nomadic groups. It is one of the most famous landmarks in China and is also one of the largest construction projects in human history.\n\nThe Great Wall stretches"} {"response":"Human:\nPlease introduce the Great Wall.\n\nAssistant:\n The Great Wall of China is a series of fortifications built along the northern borders of China to protect against invasions and raids from various nomadic groups. It is one of the most famous landmarks in China and is also one of the largest construction projects in human history.\n\nThe Great Wall stretches"}
``` ```
## 应用场景
### 算法类别
对话问答
### 热点应用行业
电信、能源、交通、航空、钢铁、金融、医疗、建筑
## 源码仓库及问题反馈
http://developer.hpccube.com/codes/modelzoo/jiutian-139moe-chat.git
## 参考资料
[JIUTIAN-139MoE-Chat · 模型库 (modelscope.cn)](https://www.modelscope.cn/models/JiuTian-AI/JIUTIAN-139MoE-chat)
\ No newline at end of file
# 模型唯一标识
modelCode = 969
# 模型名称
modelName=JIUTIAN-139MoE-Chat_pytorch
# 模型描述
modelDescription=JIUTIAN-139MoE是一个拥有130亿参数的大型语言模型,使用解码器型的MoE架构,包含一对大专家和六个小专家。模型支持在不同GPU和NPU集群上训练,并能无损切换。在FFN层采用MoE设计,有特殊的激活和路由机制。
# 应用场景
appScenario=推理,对话问答,电信,能源,交通,航空,钢铁,金融,医疗,建筑
# 框架类型
frameType=pytorch
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment