vllm/v1/engine/mm_input_cache.py · 3556a414341033aad1bbb84674ec16b235324b25 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[VLM] Limit multimodal input cache by memory (#14805) · 3556a414
Cyrus Leung authored Mar 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
3556a414

mm_input_cache.py 5.79 KB