# Triton Distributed

A Datacenter Scale Distributed Inference Serving Framework

[![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0) Triton Distributed is a flexible, component based, data center scale inference serving framework designed to leverage the strengths of the standalone Triton Inference Server while expanding its capabilities to meet the demands of complex use cases including those of Generative AI. It is designed to enable developers to implement and customize routing, load balancing, scaling and workflow definitions at the data center scale without sacrificing performance or ease of use. > [!NOTE] > This project is currently in the alpha / experimental / > rapid-prototyping stage and we are actively looking for feedback and > collaborators.