Skip to content

GitLab

Unverified Commit 181ccf43 authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

don't pass extra kwargs to mamba any more (#1328)

parent 4477d572
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 2 deletions
lm_eval/models/mamba_lm.py
View file @ 181ccf43
...@@ -42,7 +42,7 @@ class MambaLMWrapper(HFLM): ...@@ -42,7 +42,7 @@ class MambaLMWrapper(HFLM):
The HFLM arguments The HFLM arguments
`backend`, `revision`, `subfolder`, `tokenizer`, `truncation`, `max_length`, `backend`, `tokenizer`, `truncation`, `max_length`,
`device`, `dtype`, `batch_size`, `max_batch_size`, `trust_remote_code`, `use_fast_tokenizer` `device`, `dtype`, `batch_size`, `max_batch_size`, `trust_remote_code`, `use_fast_tokenizer`
Are all supported by Mamba where they do not conflict Are all supported by Mamba where they do not conflict
...@@ -98,7 +98,6 @@ please install mamba via `pip install lm-eval[mamba]` or `pip install -e .[mamba ...@@ -98,7 +98,6 @@ please install mamba via `pip install lm-eval[mamba]` or `pip install -e .[mamba
pretrained, pretrained,
device=self._device, device=self._device,
dtype=torch.float16 if dtype == "auto" else utils.get_dtype(dtype), dtype=torch.float16 if dtype == "auto" else utils.get_dtype(dtype),
**kwargs,
) )
def _model_generate(self, context, max_length, stop, **generation_kwargs): def _model_generate(self, context, max_length, stop, **generation_kwargs):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment