vllm/executor/ray_xpu_executor.py · d25877dd9b7a09d5f9552d9d185a86dc6497bc2f · OpenDAS / vllm_cscc

[CORE] Adding support for insertion of soft-tuned prompts (#4645) · 4d6ada94

Swapnil Parekh authored Jul 09, 2024


Co-authored-by: Swapnil Parekh <swapnilp@ibm.com>
Co-authored-by: Joe G <joseph.granados@h2o.ai>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

4d6ada94

ray_xpu_executor.py 16.1 KB

Replace ray_xpu_executor.py