vllm/model_executor/models/utils.py · 69ff99fdcddf4d6dbcebf5f750b121dd171b86a3 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Optimizing cross-attention `QKVParallelLinear` computation (#12325) · 69ff99fd

Nicolò Lucchesi authored Mar 06, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>
Co-authored-by: NickLucche <nick@nlucches-4xa100.c.openshift-330514.internal>

69ff99fd

utils.py 21.3 KB