Skip to content

GitLab

Unverified Commit d703eaae authored by Younes Belkada's avatar Younes Belkada Committed by GitHub
Browse files

[`bnb`] Fix bnb slow tests (#28788) 

fix bnb slow tests
parent 74c9cfea
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
src/transformers/utils/quantization_config.py
View file @ d703eaae
...@@ -342,6 +342,8 @@ class BitsAndBytesConfig(QuantizationConfigMixin): ...@@ -342,6 +342,8 @@ class BitsAndBytesConfig(QuantizationConfigMixin):
""" """
output = copy.deepcopy(self.__dict__) output = copy.deepcopy(self.__dict__)
output["bnb_4bit_compute_dtype"] = str(output["bnb_4bit_compute_dtype"]).split(".")[1] output["bnb_4bit_compute_dtype"] = str(output["bnb_4bit_compute_dtype"]).split(".")[1]
output["load_in_4bit"] = self.load_in_4bit
output["load_in_8bit"] = self.load_in_8bit
return output return output
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment