Unverified Commit 9524a464 authored by zhongdaor-nv's avatar zhongdaor-nv Committed by GitHub
Browse files

fix: Adding back runtime_config so that tool_parser work properly on … (#2855)


Co-authored-by: default avatarZhongdao Ren <zhongdaor@ipp1-3309.ipp1a1.colossus.nvidia.com>
parent ab9d8f7b
......@@ -300,6 +300,7 @@ async def init(runtime: DistributedRuntime, config: Config):
config.served_model_name,
kv_cache_block_size=config.kv_block_size,
migration_limit=config.migration_limit,
runtime_config=runtime_config,
)
if config.publish_events_and_metrics and is_first_worker(config):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment