dive_in_examples.rst 1.26 KB
Newer Older
1
2
3
4
5
6
7
The examples below assume you build the latest image yourself from source. If using a prebuilt image follow the examples from the corresponding branch.

.. grid:: 1 2 2 2
    :gutter: 3
    :margin: 0
    :padding: 3 4 0 0

8
9
    .. grid-item-card:: :doc:`Hello World <../examples/runtime/hello_world/README>`
        :link: ../examples/runtime/hello_world/README
10
11
12
13
        :link-type: doc

        Demonstrates the basic concepts of Dynamo by creating a simple GPU-unaware graph

14
15
    .. grid-item-card:: :doc:`vLLM <../backends/vllm/README>`
        :link: ../backends/vllm/README
16
17
18
19
        :link-type: doc

        Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with VLLM.

20
21
    .. grid-item-card:: :doc:`SGLang <../backends/sglang/README>`
        :link: ../backends/sglang/README
22
23
24
25
        :link-type: doc

        Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with SGLang.

26
27
    .. grid-item-card:: :doc:`TensorRT-LLM <../backends/trtllm/README>`
        :link: ../backends/trtllm/README
28
29
30
31
32
        :link-type: doc

        Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with TensorRT-LLM.