"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "7c1149120829eb58e42a1ba4dbd2a9fa98864707"
Unverified Commit 33f4cb10 authored by Younes Belkada's avatar Younes Belkada Committed by GitHub
Browse files

[`bnb`] fix bnb failing test (#22439)

* fix bnb failing test

* fix

* fix

* fixup
parent fab1de72
...@@ -384,9 +384,8 @@ class MixedInt8TestMultiGpu(BaseMixedInt8Test): ...@@ -384,9 +384,8 @@ class MixedInt8TestMultiGpu(BaseMixedInt8Test):
Let's just try to load a model on 2 GPUs and see if it works. The model we test has ~2GB of total, 3GB should suffice Let's just try to load a model on 2 GPUs and see if it works. The model we test has ~2GB of total, 3GB should suffice
""" """
memory_mapping = {0: "1GB", 1: "2GB"}
model_parallel = AutoModelForCausalLM.from_pretrained( model_parallel = AutoModelForCausalLM.from_pretrained(
self.model_name, load_in_8bit=True, max_memory=memory_mapping, device_map="auto" self.model_name, load_in_8bit=True, device_map="balanced"
) )
# Check correct device map # Check correct device map
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment