Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "497670998b5fdfd933cbdeb51fbc1673fe036162"
Unverified Commit 8edd23dc authored by Ziqi Fan's avatar Ziqi Fan Committed by GitHub
Browse files

fix: change trtllm kv_router default block_size to 32 (#642)

parent 988e8826
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/tensorrt_llm/components/kv_router.py
View file @ 8edd23dc
......@@ -51,7 +51,7 @@ def parse_args(service_name, prefix) -> Namespace:
parser.add_argument(
"--block-size",
type=int,
default=64,
default=32,
help="KV block size",
)
parser.add_argument(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment