Skip to content

GitLab

Unverified Commit eeb94dab authored by Hongkuan Zhou's avatar Hongkuan Zhou Committed by GitHub
Browse files

docs: update env setup in planner tests (#3029) 


Signed-off-by: default avatarhongkuanz <hongkuanz@nvidia.com>
parent bd835b03
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
tests/planner/README.md
View file @ eeb94dab
...@@ -10,6 +10,8 @@ This directory contains comprehensive testing tools for validating the SLA plann ...@@ -10,6 +10,8 @@ This directory contains comprehensive testing tools for validating the SLA plann
The SLA planner monitors metrics every 60 seconds (default adjustment interval) and scales The SLA planner monitors metrics every 60 seconds (default adjustment interval) and scales
prefill/decode workers based on TTFT, ITL, and request patterns. prefill/decode workers based on TTFT, ITL, and request patterns.
To setup the environment, simply use the released docker images for any backends, or build your own docker image following the READMEs in `./components/backends/<vllm/sglang/trtllm>/README.md`, or follow the `Developing Locally` section in [README.md](../../README.md) to setup the environment locally.
## Pre-Requisite: Pre-Deployment Profiling Data ## Pre-Requisite: Pre-Deployment Profiling Data
You have two options to obtain the pre-deployment profiling data: You have two options to obtain the pre-deployment profiling data:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment