dive_in_examples.rst 1.34 KB
Newer Older
1
2
3
4
5
6
7
The examples below assume you build the latest image yourself from source. If using a prebuilt image follow the examples from the corresponding branch.

.. grid:: 1 2 2 2
    :gutter: 3
    :margin: 0
    :padding: 3 4 0 0

8
9
    .. grid-item-card:: :doc:`Hello World <../examples/custom_backend/hello_world/README>`
        :link: ../examples/custom_backend/hello_world/README
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
        :link-type: doc

        Demonstrates the basic concepts of Dynamo by creating a simple GPU-unaware graph

    .. grid-item-card:: :doc:`vLLM <../components/backends/vllm/README>`
        :link: ../components/backends/vllm/README
        :link-type: doc

        Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with VLLM.

    .. grid-item-card:: :doc:`SGLang <../components/backends/sglang/README>`
        :link: ../components/backends/sglang/README
        :link-type: doc

        Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with SGLang.

    .. grid-item-card:: :doc:`TensorRT-LLM <../components/backends/trtllm/README>`
        :link: ../components/backends/trtllm/README
        :link-type: doc

        Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with TensorRT-LLM.