install.rst 949 Bytes
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
Pip (PyPI)
----------

Install a pre-built wheel from PyPI.

.. code-block:: bash

   # Create a virtual environment and activate it
   uv venv venv
   source venv/bin/activate

   # Install Dynamo from PyPI (choose one backend extra)
   uv pip install "ai-dynamo[sglang]==0.4.1"  # or [vllm], [trtllm]


Pip from source
---------------

Install directly from a local checkout for development.

.. code-block:: bash

   # Clone the repository
   git clone https://github.com/ai-dynamo/dynamo.git
   cd dynamo

   # Create a virtual environment and activate it
   uv venv venv
   source venv/bin/activate
   uv pip install ".[sglang]"  # or [vllm], [trtllm]


Docker
------

Pull and run prebuilt images from NVIDIA NGC (`nvcr.io`).

.. code-block:: bash

   # Run a container (mount your workspace if needed)
   docker run --rm -it \
     --gpus all \
     --network host \
     nvcr.io/nvidia/ai-dynamo/sglang-runtime:0.4.1  # or vllm, tensorrtllm