Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
c154d893
Unverified
Commit
c154d893
authored
May 21, 2025
by
GiantCroc
Committed by
GitHub
May 21, 2025
Browse files
[Doc] fix arg docstring in linear layers (#18410)
Signed-off-by:
giantcroc
<
1204449533@qq.com
>
parent
eca18691
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
0 deletions
+9
-0
vllm/model_executor/layers/linear.py
vllm/model_executor/layers/linear.py
+9
-0
No files found.
vllm/model_executor/layers/linear.py
View file @
c154d893
...
...
@@ -261,6 +261,7 @@ class ReplicatedLinear(LinearBase):
quant_config: Quantization configure.
prefix: The name of the layer in the state dict, including all parents
(e.g. model.layers.0.qkv_proj)
return_bias: If true, return bias together with outputs in forward pass.
"""
def
__init__
(
...
...
@@ -523,6 +524,7 @@ class MergedColumnParallelLinear(ColumnParallelLinear):
quant_config: Quantization configure.
prefix: The name of the layer in the state dict, including all parents
(e.g. model.layers.0.qkv_proj)
return_bias: If true, return bias together with outputs in forward pass.
"""
def
__init__
(
...
...
@@ -805,6 +807,7 @@ class QKVParallelLinear(ColumnParallelLinear):
quant_config: Quantization configure.
prefix: The name of the layer in the state dict, including all parents
(e.g. model.layers.0.qkv_proj)
return_bias: If true, return bias together with outputs in forward pass.
"""
def
__init__
(
...
...
@@ -1155,7 +1158,13 @@ class RowParallelLinear(LinearBase):
bias can be fused with other element-wise operations.
We skip adding bias but instead return it.
params_dtype: Data type for the parameters.
reduce_results: If true, call all-reduce on output and make Y available
to all GPUs, otherwise, every GPU will have its output
which is Y = X_iA_i
quant_config: Quantization configure.
prefix: The name of the layer in the state dict, including all parents
(e.g. model.layers.0.down_proj)
return_bias: If true, return bias together with outputs in forward pass.
"""
def
__init__
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment