Unverified Commit 4b046a72 authored by Jonah Bernard's avatar Jonah Bernard Committed by GitHub
Browse files

docs(server-arguments): add allowed options for each argument (#11560)

parent 770d6312
This diff is collapsed.
...@@ -2816,7 +2816,7 @@ class ServerArgs: ...@@ -2816,7 +2816,7 @@ class ServerArgs:
"--ds-sparse-decode-threshold", "--ds-sparse-decode-threshold",
type=int, type=int,
default=ServerArgs.ds_sparse_decode_threshold, default=ServerArgs.ds_sparse_decode_threshold,
help="The type of heavy channels in double sparsity attention", help="The minimum decode sequence length required before the double-sparsity backend switches from the dense fallback to the sparse decode kernel.",
) )
# Offloading # Offloading
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment