Skip to content

GitLab

Commit 2710920e authored by zhangwq5's avatar zhangwq5
Browse files

modification2

parent 2b6e4e6a
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
README.md
View file @ 2710920e
...@@ -31,7 +31,7 @@ pip install sentence-transformers>=4.1.0 ...@@ -31,7 +31,7 @@ pip install sentence-transformers>=4.1.0
``` ```
### Dockerfile（方法二） ### Dockerfile（方法二）
此处提供dockerfile的使用方法 此处提供dockerfile的使用方法
``` ```bash
cd docker cd docker
docker build --no-cache -t multilingual-e5:latest . docker build --no-cache -t multilingual-e5:latest .
docker run -it --shm-size 200g --network=host --name {docker_name} --privileged --device=/dev/kfd --device=/dev/dri --device=/dev/mkfd --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro {imageID} bash docker run -it --shm-size 200g --network=host --name {docker_name} --privileged --device=/dev/kfd --device=/dev/dri --device=/dev/mkfd --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root -v /path/your_code_data/:/path/your_code_data/ -v /opt/hyhal/:/opt/hyhal/:ro {imageID} bash
...@@ -62,14 +62,14 @@ pip install sentence-transformers>=2.7.0 ...@@ -62,14 +62,14 @@ pip install sentence-transformers>=2.7.0
暂无 暂无
## 推理 ## 推理
### vllm推理方法 ### vllm推理方法
``` ```bash
## 必须添加HF_ENDPOINT环境变量 ## 必须添加HF_ENDPOINT环境变量
export HF_ENDPOINT=https://hf-mirror.com export HF_ENDPOINT=https://hf-mirror.com
## model_name_or_path 模型地址参数 ## model_name_or_path 模型地址参数
python ./infer/infer_vllm.py --model /path/your_model_path/ python ./infer/infer_vllm.py --model /path/your_model_path/
``` ```
### sentence-transformers推理方法 ### sentence-transformers推理方法
``` ```bash
## 必须添加HF_ENDPOINT环境变量 ## 必须添加HF_ENDPOINT环境变量
export HF_ENDPOINT=https://hf-mirror.com export HF_ENDPOINT=https://hf-mirror.com
## model_name_or_path 模型地址参数 ## model_name_or_path 模型地址参数
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment