vllm/entrypoints/anthropic/serving.py · 262b76a09fafe15cff7642f3eee433fb903cf1d8 · OpenDAS / vllm_cscc

[Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0

Nick Hill authored Mar 11, 2026


Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

262b76a0

serving.py 33.2 KB

Replace serving.py