Commit 2c702890 authored by myhloli's avatar myhloli
Browse files

docs: add GPU requirements and multi-GPU usage tips to README files

parent d29cf4e0
...@@ -665,6 +665,12 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine ...@@ -665,6 +665,12 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine
mineru-sglang-server --port 30000 mineru-sglang-server --port 30000
``` ```
> [!TIP]
> sglang acceleration requires a GPU with Ampere architecture or newer, and at least 24GB VRAM. If you have two 12GB or 16GB GPUs, you can use Tensor Parallelism (TP) mode:
> `mineru-sglang-server --port 30000 --tp 2`
>
> If you still encounter out-of-memory errors with two GPUs, or if you need to improve throughput or inference speed using multi-GPU parallelism, please refer to the [sglang official documentation](https://docs.sglang.ai/backend/server_arguments.html#common-launch-commands).
2. Use Client in another terminal: 2. Use Client in another terminal:
```bash ```bash
......
...@@ -493,8 +493,8 @@ uv pip install -e .[core] -i https://mirrors.aliyun.com/pypi/simple ...@@ -493,8 +493,8 @@ uv pip install -e .[core] -i https://mirrors.aliyun.com/pypi/simple
``` ```
> [!TIP] > [!TIP]
> Linux和macOS系统安装后自动支持cuda/mps加速,Windows用户如需使用cuda加速,请前往 [Pytorch官网](https://pytorch.org/get-started/locally/) > Linux和macOS系统安装后自动支持cuda/mps加速,Windows用户如需使用cuda加速,
> 选择合适的cuda版本安装pytorch。 > 请前往 [Pytorch官网](https://pytorch.org/get-started/locally/) 选择合适的cuda版本安装pytorch。
#### 1.3 安装完整版(支持 sglang 加速)(需确保设备有Ampere及以后架构,24G显存及以上显卡) #### 1.3 安装完整版(支持 sglang 加速)(需确保设备有Ampere及以后架构,24G显存及以上显卡)
...@@ -654,6 +654,12 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine ...@@ -654,6 +654,12 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine
mineru-sglang-server --port 30000 mineru-sglang-server --port 30000
``` ```
> [!TIP]
> sglang加速需设备有Ampere及以后架构,24G显存及以上显卡,如您有两张12G或16G显卡,可以通过张量并行(TP)模式使用。
> `mineru-sglang-server --port 30000 --tp 2`
>
> 如使用两张卡仍出现显存不足错误或需要使用多卡并行增加吞吐量或推理速度,请参考 [sglang官方文档](https://docs.sglang.ai/backend/server_arguments.html#common-launch-commands)
2. 在另一个终端中使用 Client 调用: 2. 在另一个终端中使用 Client 调用:
```bash ```bash
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment