Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
562c7f51
Unverified
Commit
562c7f51
authored
Apr 29, 2025
by
Hongkuan Zhou
Committed by
GitHub
Apr 29, 2025
Browse files
docs: update pythonpath for starting planner (#890)
parent
0919c0f9
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
4 additions
and
4 deletions
+4
-4
components/planner/README.md
components/planner/README.md
+1
-1
docs/guides/planner_benchmark/benchmark_planner.md
docs/guides/planner_benchmark/benchmark_planner.md
+2
-2
docs/planner.md
docs/planner.md
+1
-1
No files found.
components/planner/README.md
View file @
562c7f51
...
...
@@ -24,7 +24,7 @@ The planner is a component that monitors the state of the system and makes adjus
After you've deployed a dynamo graph, you can start the planner with the following command:
```
bash
python components/planner.py
--namespace
<namespace>
PYTHONPATH
=
/workspace/examples/llm
python components/planner.py
--namespace
<namespace>
```
## Backends
...
...
docs/guides/planner_benchmark/benchmark_planner.md
View file @
562c7f51
...
...
@@ -51,7 +51,7 @@ cd examples/llm
dynamo serve graphs.disagg:Frontend
-f
<path to disagg_1p1d.yml
in
this folder>
--enable-local-planner
# in terminal 2
python components/planner.py
\
PYTHONPATH
=
/workspace/examples/llm
python components/planner.py
\
--metric-pulling-interval
1
\
--adjustment-interval
10
\
--prefill-queue-scale-down-threshold
0.2
\
...
...
@@ -95,7 +95,7 @@ In this example, we use a fixed 2p2d engine as baseline. Planner provides a `--n
dynamo serve
--enable-local-planner
graphs.disagg:Frontend
-f
disagg_2p2d.yml
# in terminal 2 (optional)
python components/planner.py
--no-operation
--log-dir
log/2p2d
PYTHONPATH
=
/workspace/examples/llm
python components/planner.py
--no-operation
--log-dir
log/2p2d
# in terminal 3
genai-perf profile
--tokenizer
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
-m
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
--service-kind
openai
--endpoint-type
chat
--url
http://localhost:8000
--streaming
--input-file
payload:sin_b512_t600_rr5.0-20.0-150.0_io3000150-3000150-0.2-0.8-10.jsonl
...
...
docs/planner.md
View file @
562c7f51
...
...
@@ -51,7 +51,7 @@ There are two additional rules set by planner to prevent over-compensation:
## Usage
After you've deployed a dynamo graph - you can start the planner with the following command:
```
bash
python components/planner.py <arguments>
PYTHONPATH
=
/workspace/examples/llm
python components/planner.py <arguments>
```
Planner takes the following arguments:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment