vllm/triton_utils/custom_cache_manager.py · 705f6a35aa92800b9c69c8b346168c3055fdebbd · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix] Add custom Triton cache manager to resolve MoE MP issue (#6140) · eaec4b91
Thomas Parnell authored Jul 15, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Chih-Chieh-Yang <chih.chieh.yang@ibm.com>
```
eaec4b91

custom_cache_manager.py 2.17 KB