install.rst 951 Bytes
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
Pip (PyPI)
----------

Install a pre-built wheel from PyPI.

.. code-block:: bash

   # Create a virtual environment and activate it
   uv venv venv
   source venv/bin/activate

   # Install Dynamo from PyPI (choose one backend extra)
13
   uv pip install "ai-dynamo[sglang]==my-tag"  # or [vllm], [trtllm]
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43


Pip from source
---------------

Install directly from a local checkout for development.

.. code-block:: bash

   # Clone the repository
   git clone https://github.com/ai-dynamo/dynamo.git
   cd dynamo

   # Create a virtual environment and activate it
   uv venv venv
   source venv/bin/activate
   uv pip install ".[sglang]"  # or [vllm], [trtllm]


Docker
------

Pull and run prebuilt images from NVIDIA NGC (`nvcr.io`).

.. code-block:: bash

   # Run a container (mount your workspace if needed)
   docker run --rm -it \
     --gpus all \
     --network host \
44
     nvcr.io/nvidia/ai-dynamo/sglang-runtime:my-tag  # or vllm, tensorrtllm