Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
84e4e37d
Unverified
Commit
84e4e37d
authored
Oct 02, 2023
by
Woosuk Kwon
Committed by
GitHub
Oct 02, 2023
Browse files
[Minor] Fix type annotations (#1238)
parent
a60b3530
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
4 deletions
+3
-4
vllm/model_executor/layers/sampler.py
vllm/model_executor/layers/sampler.py
+1
-1
vllm/sampling_params.py
vllm/sampling_params.py
+2
-3
No files found.
vllm/model_executor/layers/sampler.py
View file @
84e4e37d
...
...
@@ -290,7 +290,7 @@ def _get_topk_logprobs(
def
_build_sequence_outputs
(
parent_ids
:
List
[
int
],
next_token_ids
:
List
[
int
],
selected_token_logprobs
:
torch
.
Tensor
,
selected_token_logprobs
:
List
[
float
]
,
parent_seq_ids
:
List
[
int
],
parent_logprobs
:
torch
.
Tensor
,
num_output_logprobs
:
Optional
[
int
],
...
...
vllm/sampling_params.py
View file @
84e4e37d
...
...
@@ -61,7 +61,6 @@ class SamplingParams:
max_tokens: Maximum number of tokens to generate per output sequence.
logprobs: Number of log probabilities to return per output token.
skip_special_tokens: Whether to skip special tokens in the output.
Defaults to true.
"""
def
__init__
(
...
...
@@ -76,8 +75,8 @@ class SamplingParams:
use_beam_search
:
bool
=
False
,
length_penalty
:
float
=
1.0
,
early_stopping
:
Union
[
bool
,
str
]
=
False
,
stop
:
Union
[
None
,
str
,
List
[
str
]]
=
None
,
stop_token_ids
:
List
[
int
]
=
None
,
stop
:
Optional
[
Union
[
str
,
List
[
str
]]
]
=
None
,
stop_token_ids
:
Optional
[
List
[
int
]
]
=
None
,
ignore_eos
:
bool
=
False
,
max_tokens
:
int
=
16
,
logprobs
:
Optional
[
int
]
=
None
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment