Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
4c062d44
Unverified
Commit
4c062d44
authored
Aug 23, 2023
by
Hailey Schoelkopf
Committed by
GitHub
Aug 23, 2023
Browse files
Update huggingface.py
parent
436edcc9
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
lm_eval/models/huggingface.py
lm_eval/models/huggingface.py
+2
-2
No files found.
lm_eval/models/huggingface.py
View file @
4c062d44
...
...
@@ -162,7 +162,7 @@ class HuggingFaceAutoLM(BaseLM):
gptq_use_triton (bool, optional, defaults to False):
Use Triton for GPTQ inference.
inject_fused_attention (bool, optional, defaults to True):
Inject fused attention.
Inject fused attention
into GPTQ model
.
bnb_4bit_quant_type (str, optional, defaults to None):
The quantization type to use for BnB 4bit quantization. See:
https://github.com/huggingface/transformers/blob/main/src/transformers/utils/quantization_config.py#L77
...
...
@@ -781,4 +781,4 @@ def stop_sequences_criteria(
for
sequence
in
stop_sequences
],
]
)
\ No newline at end of file
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment