Unverified Commit b4f23a13 authored by Shuaiyi Zhang's avatar Shuaiyi Zhang Committed by GitHub
Browse files

fix: Add block-size parameter to Router in the example (#1210)


Signed-off-by: default avatarShuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: default avatarShuaiyi Zhang <zhangsy28@lenovo.com>
Co-authored-by: default avatarYan Ru Pei <yanrpei@gmail.com>
parent a8bdc0be
......@@ -29,7 +29,7 @@ Processor:
Router:
min-workers: 1
common-configs: [model, router]
common-configs: [model, block-size, router]
VllmWorker:
enforce-eager: true
......
......@@ -29,7 +29,7 @@ Processor:
Router:
min-workers: 1
common-configs: [model, router]
common-configs: [model, block-size, router]
VllmWorker:
max-num-batched-tokens: 16384
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment