vllm/worker/model_runner.py · 4d6ada947c7e6379b6857bc9a9a1203679d32039 · OpenDAS / vllm_cscc

"vllm/model_executor/models/nemotron.py" did not exist on "9e0b558a0923004758a9dc91f5d4920ded48b42a"

[CORE] Adding support for insertion of soft-tuned prompts (#4645) · 4d6ada94

Swapnil Parekh authored Jul 09, 2024


Co-authored-by: Swapnil Parekh <swapnilp@ibm.com>
Co-authored-by: Joe G <joseph.granados@h2o.ai>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

4d6ada94

model_runner.py 70.4 KB

Replace model_runner.py