"git@developer.sourcefind.cn:OpenDAS/ollama.git" did not exist on "3bc8b9832b3bfab9ddca01ec0ebc012303362361"
Commit b36e812c authored by myhloli's avatar myhloli
Browse files

docs: update README to change TIP to NOTE and add new TIP for sglang-server parameters

parent 1d57371f
...@@ -502,7 +502,7 @@ cd MinerU ...@@ -502,7 +502,7 @@ cd MinerU
uv pip install -e .[core] uv pip install -e .[core]
``` ```
> [!TIP] > [!NOTE]
> Linux and macOS systems automatically support CUDA/MPS acceleration after installation. For Windows users who want to use CUDA acceleration, > Linux and macOS systems automatically support CUDA/MPS acceleration after installation. For Windows users who want to use CUDA acceleration,
> please visit the [PyTorch official website](https://pytorch.org/get-started/locally/) to install PyTorch with the appropriate CUDA version. > please visit the [PyTorch official website](https://pytorch.org/get-started/locally/) to install PyTorch with the appropriate CUDA version.
...@@ -665,6 +665,7 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine ...@@ -665,6 +665,7 @@ mineru -p <input_path> -o <output_path> -b vlm-sglang-engine
mineru-sglang-server --port 30000 mineru-sglang-server --port 30000
``` ```
> [!TIP]
> sglang-server has some commonly used parameters for configuration: > sglang-server has some commonly used parameters for configuration:
> - If you have two GPUs with `12GB` or `16GB` VRAM, you can use the Tensor Parallel (TP) mode: `--tp 2` > - If you have two GPUs with `12GB` or `16GB` VRAM, you can use the Tensor Parallel (TP) mode: `--tp 2`
> - If you have two GPUs with `11GB` VRAM, in addition to Tensor Parallel mode, you need to reduce the KV cache size: `--tp 2 --mem-fraction-static 0.7` > - If you have two GPUs with `11GB` VRAM, in addition to Tensor Parallel mode, you need to reduce the KV cache size: `--tp 2 --mem-fraction-static 0.7`
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment