modification

README.md

@@ -32,8 +32,13 @@ pip install sentence-transformers>=4.1.0
 ### Dockerfile（方法二）
 此处提供dockerfile的使用方法
 ```
-docker build --no-cache -t xxx:latest .
-docker run xxx
+cd docker
+docker build --no-cache -t multilingual-e5:latest .
+docker run -it --shm-size 200g --network=host --name {docker_name} --privileged --device=/dev/kfd --device=/dev/dri --device=/dev/mkfd --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro {imageID} bash
+
+cd /your_code_path/multilingual-e5_pytorch
+pip install transformers>=4.51.0
+pip install sentence-transformers>=2.7.0
 ```
 ### Anaconda（方法三）
 关于本项目DCU显卡所需的特殊深度学习库可从[光合](https://developer.sourcefind.cn/tool/)开发者社区下载安装。
@@ -58,8 +63,18 @@ pip install sentence-transformers>=2.7.0
 ## 推理
 ### vllm推理方法
 ```
+## 必须添加HF_ENDPOINT环境变量
+export HF_ENDPOINT=https://hf-mirror.com
+## model_name_or_path 模型地址参数
 python ./infer/infer_vllm.py --model /path/your_model_path/
 ```
+### sentence-transformers推理方法
+```
+## 必须添加HF_ENDPOINT环境变量
+export HF_ENDPOINT=https://hf-mirror.com
+## model_name_or_path 模型地址参数
+python ./infer/infer_sentence_transformers.py
+```
 ## result
 ```
 提示: '你好，我的名字是' | 嵌入: [0.018951416015625, -0.0121612548828125, -0.042022705078125, -0.03936767578125, 0.007015228271484375, -0.040130615234375, -0.0189361572265625, 0.04925537109375, 0.037322998046875, -0.01776123046875, 0.035614013671875, 0.01861572265625, -0.048248291015625, -0.015716552734375, -0.032745361328125, -0.01061248779296875, ...] (大小=1024)

docker/Dockerfile

+FROM image.sourcefind.cn:5000/dcu/admin/base/custom:vllm0.8.5-ubuntu22.04-dtk25.04-rc7-das1.5-py3.10-20250612-fixpy-rocblas0611-rc2
\ No newline at end of file

infer/infer_sentece_transformers.py

 from sentence_transformers import SentenceTransformer
-model = SentenceTransformer('/home/zwq2/model/models/multilingual-e5-large/multilingual-e5-large')
+
+
+parse = argparse.ArgumentParser()
+parse.add_argument("--model_name_or_path", type=str, default="intfloat/multilingual-e5-large")
+args = parse.parse_args()
+
+# Load the model
+model = SentenceTransformer(args.model_name_or_path)
 input_texts = [
     'query: how much protein should a female eat',
     'query: 南瓜的家常做法',

infer/infer_vllm.py

@@ -42,7 +42,7 @@ if __name__ == "__main__":
     parser = FlexibleArgumentParser()
     parser = EngineArgs.add_cli_args(parser)
   
-    parser.set_defaults(model="/home/zwq/model/models/multilingual-e5-large/multilingual-e5-large",
+    parser.set_defaults(model="intfloat/multilingual-e5-large",
                        task="embed",
                        enforce_eager=True)
     args = parser.parse_args()