[Core] Remove prompt string from engine core data structures (#17214)

Signed-off-by: Nick Hill <nhill@redhat.com>

[Core] Remove prompt string from engine core data structures (#17214)
Signed-off-by: Nick Hill <nhill@redhat.com>
df6f3ce8 · Nick Hill · GitHub · 513f0747 · df6f3ce8
Unverified Commit df6f3ce8 authored Apr 25, 2025 by Nick Hill Committed by GitHub Apr 25, 2025
Show whitespace changes
Inline Side-by-side

Showing with 0 additions and 1 deletion

vllm/v1/worker/tpu_model_runner.py vllm/v1/worker/tpu_model_runner.py +0 -1

No files found.
--- a/vllm/v1/worker/tpu_model_runner.py
+++ b/vllm/v1/worker/tpu_model_runner.py
@@ -356,7 +356,6 @@ class TPUModelRunner:
            self.requests[req_id] = CachedRequestState(
                req_id=req_id,
                prompt_token_ids=new_req_data.prompt_token_ids,
-                prompt=new_req_data.prompt,
                mm_inputs=new_req_data.mm_inputs,
                mm_positions=new_req_data.mm_positions,
                sampling_params=sampling_params,