"...tio/src/git@developer.sourcefind.cn:OpenDAS/dynamo.git" did not exist on "110f3f8caeff051b32f168c44fda9faa0d71ed18"
Commit a8c5637f authored by Ryan McCormick's avatar Ryan McCormick Committed by GitHub
Browse files

docs: Add link to LLM example in top level README (#61)

parent f6d723f6
...@@ -89,9 +89,19 @@ deployment instructions. ...@@ -89,9 +89,19 @@ deployment instructions.
[Hello World](./examples/hello_world) [Hello World](./examples/hello_world)
A basic example demonstrating the new interfaces and concepts of A basic example demonstrating the new interfaces and concepts of
triton distributed. In the hello world example, you can deploy a set Triton Distributed. In the Hello World example, you can deploy a set
of simple workers to load balance requests from a local work queue. of simple workers to load balance requests from a local work queue.
## LLM
[LLM](./examples/llm/vllm)
An intermediate example expanding further on the concepts indroduced
in the Hello World example. In this example, we demonstrate
[Disaggregated Serving](https://arxiv.org/abs/2401.09670)
as an application of the components defined in Triton Distributed.
# Disclaimers # Disclaimers
> [!NOTE] > [!NOTE]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment