"cacheflow/vscode:/vscode.git/clone" did not exist on "84eee24e20ff4c0fc1b126289265f560089efa47"
Unverified Commit c44c384b authored by Rui Qiao's avatar Rui Qiao Committed by GitHub
Browse files

[Misc] Add references in ray_serve_deepseek example (#17907)


Signed-off-by: default avatarRui Qiao <ruisearch42@gmail.com>
parent 85b72cb7
# SPDX-License-Identifier: Apache-2.0 # SPDX-License-Identifier: Apache-2.0
""" """
Example to deploy DeepSeek R1 or V3 with Ray Serve LLM. Example to deploy DeepSeek R1 or V3 with Ray Serve LLM.
See Ray Serve LLM documentation at: See more details at:
https://docs.ray.io/en/latest/serve/tutorials/serve-deepseek.html
And see Ray Serve LLM documentation at:
https://docs.ray.io/en/latest/serve/llm/serving-llms.html https://docs.ray.io/en/latest/serve/llm/serving-llms.html
Run `python3 ray_serve_deepseek.py` to deploy the model. Run `python3 ray_serve_deepseek.py` to deploy the model.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment