fix: Pass empty tokens for new requests for TRTLLM (#5620)

22fbc022 · Kris Hung · GitHub · fbf91daf · 22fbc022
Unverified Commit 22fbc022 authored Jan 26, 2026 by Kris Hung Committed by GitHub Jan 26, 2026
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

lib/bindings/kvbm/src/block_manager/vllm/connector/trtllm_leader.rs ...gs/kvbm/src/block_manager/vllm/connector/trtllm_leader.rs +1 -1

No files found.
--- a/lib/bindings/kvbm/src/block_manager/vllm/connector/trtllm_leader.rs
+++ b/lib/bindings/kvbm/src/block_manager/vllm/connector/trtllm_leader.rs
@@ -382,7 +382,7 @@ impl Leader for KvConnectorLeader {
                .unwrap_or(&0);

            slot.apply_scheduler_output(
-                &new_req.prompt_token_ids,
+                &[],
                &new_req.block_ids,
                new_req.num_computed_tokens,
                scheduled_tokens,