benchmarks/backend_request_func.py · 10398b4706ee71d0bddc32c1d33b11e73df12a27 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

fix the issue that len(tokenizer(prompt)["input_ids"]) > prompt_len (#10524) · 8a93a598
Wang, Yi authored Nov 21, 2024
```
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
```
8a93a598

backend_request_func.py 15.8 KB