examples/llm_engine_example.py · 15f5632365a98fd43ea42e4948a995aa399e99b5 · myrfy001 / vllm_dsv4 · GitLab

"tests/compile/passes/test_fusion_attn.py" did not exist on "1f8b7c536be40975573eeebf36204286cfb4e4e9"

Find file Blame History Permalink

Implement prompt logprobs & Batched topk for computing logprobs (#1328) · 9d9072a0
Zhuohan Li authored Oct 16, 2023
```
Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>
```
9d9072a0

llm_engine_example.py 1.74 KB