Skip to content

GitLab

Unverified Commit 54814fd8 authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

[Bugfix][TPU] Fix TPU sampler output (#5978)

parent 7041de43
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/worker/tpu_worker.py
View file @ 54814fd8
...@@ -215,7 +215,7 @@ class TPUWorker(LoraNotSupportedWorkerBase): ...@@ -215,7 +215,7 @@ class TPUWorker(LoraNotSupportedWorkerBase):
assert len(seq_group_metadata_list) > 0 assert len(seq_group_metadata_list) > 0
output = self.model_runner.execute_model(seq_group_metadata_list, output = self.model_runner.execute_model(seq_group_metadata_list,
self.tpu_cache) self.tpu_cache)
return [output] return output
def cache_swap( def cache_swap(
self, self,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment