Skip to content

GitLab

Unverified Commit fc402a35 authored by Biswa Panda's avatar Biswa Panda Committed by GitHub
Browse files

feat: configurable namespace for vllm v1 example (#1909)

parent df40d2ca
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/vllm/components/main.py
View file @ fc402a35
...@@ -172,7 +172,7 @@ async def init(runtime: DistributedRuntime, config: Config): ...@@ -172,7 +172,7 @@ async def init(runtime: DistributedRuntime, config: Config):
clear_endpoint = component.endpoint("clear_kv_blocks") clear_endpoint = component.endpoint("clear_kv_blocks")
prefill_worker_client = ( prefill_worker_client = (
await runtime.namespace("dynamo") await runtime.namespace(config.namespace)
.component("prefill") # TODO don't hardcode .component("prefill") # TODO don't hardcode
.endpoint("generate") .endpoint("generate")
.client() .client()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment