"tools/cfgs/git@developer.sourcefind.cn:OpenDAS/openpcdet.git" did not exist on "9fc9f152b9895ccbbfb8780b7dbcb3a3e8ba8e0b"
Commit 66f048f6 authored by Neelay Shah's avatar Neelay Shah Committed by GitHub
Browse files

docs: readme updates

parent d2e7ae02
......@@ -86,24 +86,53 @@ HF_TOKEN```) and mounts common directories such as ```/tmp:/tmp```,
Please see the instructions in the corresponding example for specific
deployment instructions.
## Hello World
## Rust Based Distributed Runtime
[Hello World](./examples/hello_world)
Triton distributed has a new rust based distributed runtime with
implementation under development. The rust based runtime enables
serving arbitrary python code as well as native rust. Please note the
APIs are subject to change.
### Hello World
[Hello World](./runtime/rust/python-wheel/examples/hello_world)
A basic example demonstrating the rust based runtime and python
bindings.
### LLM
[VLLM](./examples/python_rs/llm/vllm)
An intermediate example expanding further on the concepts introduced
in the Hello World example. In this example, we demonstrate
[Disaggregated Serving](https://arxiv.org/abs/2401.09670) as an
application of the components defined in Triton Distributed.
## Python Native Distributed Runtime
Triton distributed has a python native based distributed runtime with
implementation under development. Please note the APIs are subject to
change.
### Hello World
[Hello World](./examples/python/hello_world)
A basic example demonstrating the new interfaces and concepts of
Triton Distributed. In the Hello World example, you can deploy a set
of simple workers to load balance requests from a local work queue.
## LLM
### LLM
[TENSORRTLLM](./examples/llm/tensorrtllm)
[TENSORRTLLM](./examples/python/llm/tensorrtllm)
An intermediate example expanding further on the concepts indroduced
in the Hello World example. In this example, we demonstrate
[Disaggregated Serving](https://arxiv.org/abs/2401.09670)
as an application of the components defined in Triton Distributed.
[VLLM](./examples/llm/vllm)
[VLLM](./examples/python/llm/vllm)
An intermediate example expanding further on the concepts indroduced
in the Hello World example. In this example, we demonstrate
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment