Commit 4b1867c5 authored by Neelay Shah's avatar Neelay Shah Committed by GitHub
Browse files

chore: move examples to top level (#220)

parent f46f6d0e
...@@ -17,7 +17,12 @@ Cargo.toml @ryanolson @grahamking @paulhendricks @biswapanda @tmonty12 @guanluo ...@@ -17,7 +17,12 @@ Cargo.toml @ryanolson @grahamking @paulhendricks @biswapanda @tmonty12 @guanluo
/deploy/Kubernetes/ @whoisj @hutm @biswapanda /deploy/Kubernetes/ @whoisj @hutm @biswapanda
# Dynamo deploy # Dynamo deploy
/deploy/ @hutm @biswapanda @ishandhanani @julienmancuso @hhzhang16 /deploy/ @hutm @biswapanda @ishandhanani @julienmancuso @hhzhang16 @nnshah1
# Dynamo deploy
/examples/ @hutm @biswapanda @ishandhanani @julienmancuso @hhzhang16 @nnshah1 @tanmayv25 @piotrm-nvidia @ptarasiewiczNV @ryanolson @grahamking @paulhendricks @biswapanda @tmonty12 @guanluo @rmccorm4 @tedzhouhk @alec-flowers
# CI/CD # CI/CD
/.github/ @ai-dynamo/Devops @nnshah1 /.github/ @ai-dynamo/Devops @nnshah1
......
...@@ -369,7 +369,7 @@ RUN --mount=type=bind,source=./container/launch_message.txt,target=/workspace/la ...@@ -369,7 +369,7 @@ RUN --mount=type=bind,source=./container/launch_message.txt,target=/workspace/la
echo "cat ~/.launch_screen" >> ~/.bashrc echo "cat ~/.launch_screen" >> ~/.bashrc
# Copy examples # Copy examples
COPY ./deploy/examples examples/ COPY ./examples examples/
ENTRYPOINT [/bin/sh] ENTRYPOINT [/bin/sh]
CMD [] CMD []
\ No newline at end of file
...@@ -43,7 +43,7 @@ Users/Clients (HTTP) ...@@ -43,7 +43,7 @@ Users/Clients (HTTP)
1. Launch all three services using a single command - 1. Launch all three services using a single command -
```bash ```bash
cd /workspace/deploy/examples/hello_world cd /workspace/examples/hello_world
dynamo serve hello_world:Frontend dynamo serve hello_world:Frontend
``` ```
......
...@@ -108,25 +108,25 @@ This figure shows an overview of the major components to deploy: ...@@ -108,25 +108,25 @@ This figure shows an overview of the major components to deploy:
#### Aggregated serving #### Aggregated serving
```bash ```bash
cd /workspace/deploy/examples/llm cd /workspace/examples/llm
dynamo serve graphs.agg:Frontend -f ./configs/agg.yaml dynamo serve graphs.agg:Frontend -f ./configs/agg.yaml
``` ```
#### Aggregated serving with KV Routing #### Aggregated serving with KV Routing
```bash ```bash
cd /workspace/deploy/examples/llm cd /workspace/examples/llm
dynamo serve graphs.agg_router:Frontend -f ./configs/agg_router.yaml dynamo serve graphs.agg_router:Frontend -f ./configs/agg_router.yaml
``` ```
#### Disaggregated serving #### Disaggregated serving
```bash ```bash
cd /workspace/deploy/examples/llm cd /workspace/examples/llm
dynamo serve graphs.disagg:Frontend -f ./configs/disagg.yaml dynamo serve graphs.disagg:Frontend -f ./configs/disagg.yaml
``` ```
#### Disaggregated serving with KV Routing #### Disaggregated serving with KV Routing
```bash ```bash
cd /workspace/deploy/examples/llm cd /workspace/examples/llm
dynamo serve graphs.disagg_router:Frontend -f ./configs/disagg_router.yaml dynamo serve graphs.disagg_router:Frontend -f ./configs/disagg_router.yaml
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment