Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
baada0e7
Unverified
Commit
baada0e7
authored
Apr 09, 2025
by
Michael Goin
Committed by
GitHub
Apr 10, 2025
Browse files
[Bugfix][TPU] Fix TPU validate_request (#16369)
Signed-off-by:
Michael Goin
<
mgoin64@gmail.com
>
parent
82eb61dd
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
4 deletions
+1
-4
vllm/platforms/tpu.py
vllm/platforms/tpu.py
+1
-4
No files found.
vllm/platforms/tpu.py
View file @
baada0e7
...
...
@@ -7,20 +7,17 @@ import torch
import
vllm.envs
as
envs
from
vllm.inputs
import
PromptType
from
vllm.logger
import
init_logger
from
vllm.sampling_params
import
SamplingParams
from
.interface
import
Platform
,
PlatformEnum
,
_Backend
if
TYPE_CHECKING
:
from
vllm.config
import
ModelConfig
,
VllmConfig
from
vllm.lora.request
import
LoRARequest
from
vllm.pooling_params
import
PoolingParams
from
vllm.sampling_params
import
SamplingParams
else
:
ModelConfig
=
None
VllmConfig
=
None
LoRARequest
=
None
PoolingParams
=
None
SamplingParams
=
None
logger
=
init_logger
(
__name__
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment