@@ -15,18 +15,18 @@ See the License for the specific language governing permissions and
limitations under the License.
-->
# Deploy Dynamo Cloud to Kubernetes
# 🚀 Deploy Dynamo Cloud to Kubernetes
## Building Docker images for Dynamo Cloud components
## 🏗️ Building Docker images for Dynamo Cloud components
You can build and push Docker images for the Dynamo cloud components (API server, API store, and operator) to any container registry of your choice. Here's how to build each component:
Before deploying Dynamo Cloud, ensure your Kubernetes cluster meets the following requirements:
#### 1. Istio Installation
#### 1. 🛡️ Istio Installation
Dynamo Cloud requires Istio for service mesh capabilities. Verify Istio is installed and running:
```bash
...
...
@@ -66,7 +66,7 @@ kubectl get pods -n istio-system
# istiod-* pods should be in Running state
```
#### 2. PVC Support with Default Storage Class
#### 2. 💾 PVC Support with Default Storage Class
Dynamo Cloud requires Persistent Volume Claim (PVC) support with a default storage class. Verify your cluster configuration:
```bash
...
...
@@ -79,7 +79,10 @@ kubectl get storageclass
# standard (default) kubernetes.io/gce-pd Delete Immediate true 1d
```
### Installation
> [!TIP]
> Don't have a Kubernetes cluster? Check out our [Minikube setup guide](../../../docs/guides/dynamo_deploy/minikube.md) to set up a local environment! 🏠
The Dynamo Cloud platform is a comprehensive solution for deploying and managing Dynamo inference graphs (also referred to as pipelines) in Kubernetes environments. It provides a streamlined experience for deploying, scaling, and monitoring your inference services. You can interface with Dynamo Cloud using the `deploy` subcommand available in the Dynamo CLI (e.g `dynamo deploy`)
## Overview
## 📋 Overview
The Dynamo cloud platform consists of several key components:
...
...
@@ -31,7 +31,7 @@ These components work together to provide a seamless deployment experience, hand
## Prerequisites
## 🎯 Prerequisites
Before getting started with the Dynamo cloud platform, ensure you have:
...
...
@@ -42,11 +42,14 @@ Before getting started with the Dynamo cloud platform, ensure you have:
-`kubectl` configured to access your cluster
- Helm installed (version 3.0 or later)
## Building Docker Images for Dynamo Cloud Components
> [!TIP]
> Don't have a Kubernetes cluster? Check out our [Minikube setup guide](./minikube.md) to set up a local environment! 🏠
## 🏗️ Building Docker Images for Dynamo Cloud Components
The Dynamo cloud platform components need to be built and pushed to a container registry before deployment. You can build these components individually or all at once.
### Setting Up Environment Variables
### ⚙️ Setting Up Environment Variables
First, set the required environment variables for building and pushing images:
...
...
@@ -67,7 +70,7 @@ Where:
> docker login <CONTAINER_REGISTRY>
> ```
### Building Components
### 🛠️ Building Components
You can build and push all platform components at once:
...
...
@@ -75,15 +78,15 @@ You can build and push all platform components at once:
You must also expose the `dynamo-store` service within the namespace externally. This will be the endpoint the CLI uses to interface with Dynamo Cloud. You might setup an Ingress, use an `ExternalService` with Istio, or simply port-forward. In our docs, we refer to this externally available endpoint as `DYNAMO_CLOUD`.
## Next Steps
## 🎯 Next Steps
After deploying the Dynamo cloud platform, you can:
SPDX-FileCopyrightText: Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
SPDX-License-Identifier: Apache-2.0
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
# 🏠 Minikube Setup Guide
Don't have a Kubernetes cluster? No problem! You can set up a local development environment using Minikube. This guide will walk you through setting up everything you need to run Dynamo Cloud locally.
## Setting Up Minikube
### 1. Install Minikube
First things first! You'll need to install Minikube. Follow the official [Minikube installation guide](https://minikube.sigs.k8s.io/docs/start/) for your operating system.
### 2. Configure GPU Support (Optional)
Planning to use GPU-accelerated workloads? You'll need to configure GPU support in Minikube. Follow the [Minikube GPU guide](https://minikube.sigs.k8s.io/docs/tutorials/nvidia/) to set up NVIDIA GPU support before proceeding.
> [!TIP]
> Make sure to configure GPU support before starting Minikube if you plan to use GPU workloads!
### 3. Start Minikube
Time to launch your local cluster!
```bash
# Start Minikube with GPU support (if configured)
minikube start --driver docker --container-runtime docker --gpus all --memory=16000mb --cpus=8
Once your local environment is set up, you can proceed with the [Dynamo Cloud deployment guide](./dynamo_cloud.md) to deploy the platform to your local cluster.
