Skip to content

GitLab

Commit 24f4e8d7 authored by baberabb's avatar baberabb
Browse files

(temp) fix import

parent f2890cc1
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 1 deletion
lm_eval/models/vllm_causallms.py
View file @ 24f4e8d7
...@@ -7,7 +7,12 @@ import copy ...@@ -7,7 +7,12 @@ import copy
from tqdm import tqdm from tqdm import tqdm
from lm_eval.api.registry import register_model from lm_eval.api.registry import register_model
from lm_eval import utils from lm_eval import utils
from vllm import LLM, SamplingParams
# TODO: Fix this once complete
try:
from vllm import LLM, SamplingParams
except ModuleNotFoundError:
pass
@register_model("vllm") @register_model("vllm")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment