Return Correct Prompt Eval Count Regardless of Cache Prompt (#5371)
* openai compatibility * Revert "openai compatibility" This reverts commit d3f98a811e00fc497d889c8c45b0cfec5b64690c. * remove erroneous subtraction of prompt cache
Showing
Please register or sign in to comment