Skip to content

GitLab

Unverified Commit df6f3ce8 authored by Nick Hill's avatar Nick Hill Committed by GitHub
Browse files

[Core] Remove prompt string from engine core data structures (#17214) 


Signed-off-by: default avatarNick Hill <nhill@redhat.com>
parent 513f0747
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 1 deletion
vllm/v1/worker/tpu_model_runner.py
View file @ df6f3ce8
...@@ -356,7 +356,6 @@ class TPUModelRunner: ...@@ -356,7 +356,6 @@ class TPUModelRunner:
self.requests[req_id] = CachedRequestState( self.requests[req_id] = CachedRequestState(
req_id=req_id, req_id=req_id,
prompt_token_ids=new_req_data.prompt_token_ids, prompt_token_ids=new_req_data.prompt_token_ids,
prompt=new_req_data.prompt,
mm_inputs=new_req_data.mm_inputs, mm_inputs=new_req_data.mm_inputs,
mm_positions=new_req_data.mm_positions, mm_positions=new_req_data.mm_positions,
sampling_params=sampling_params, sampling_params=sampling_params,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment