Skip to content

GitLab

"...np/git@developer.sourcefind.cn:OpenDAS/openfold.git" did not exist on "92f1932e6bd2c7f9280bbb9f64bcd2a7a57e6733"
Commit bd8f0804 authored by Kyungmin Lee's avatar Kyungmin Lee Committed by GitHub
Browse files

fix: broken link to dynamo run (#517)

parent 43b62ce2
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/tensorrt_llm/README.md
View file @ bd8f0804
...@@ -90,7 +90,7 @@ dynamo run out=pystr:./engines/agg_engine.py -- --engine_args ./configs/llm_api_ ...@@ -90,7 +90,7 @@ dynamo run out=pystr:./engines/agg_engine.py -- --engine_args ./configs/llm_api_
``` ```
The above command should load the model specified in `llm_api_config.yaml` and start accepting The above command should load the model specified in `llm_api_config.yaml` and start accepting
text input from the client. For more details on the `dynamo run` command, please refer to the text input from the client. For more details on the `dynamo run` command, please refer to the
[dynamo run](/launch/README.md#python-bring-your-own-engine) documentation. [dynamo run](/docs/guides/dynamo_run.md#python-bring-your-own-engine) documentation.
Currently only aggregated deployment option is supported by `dynamo run` for TensorRT-LLM. Currently only aggregated deployment option is supported by `dynamo run` for TensorRT-LLM.
Adding support for disaggregated deployment is under development. This does *not* require Adding support for disaggregated deployment is under development. This does *not* require
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment