"git@developer.sourcefind.cn:OpenDAS/pytorch3d.git" did not exist on "d7d740abe9bada1d3187118b2e8d54b9c119737b"
Unverified Commit a26d5709 authored by geronimi73's avatar geronimi73 Committed by GitHub
Browse files

AutoModel instead of AutoModelForCausalLM (#10507)

parent daf9d0f1
...@@ -59,10 +59,10 @@ Refer to the [Quantization](../../quantization/overview) overview to learn more ...@@ -59,10 +59,10 @@ Refer to the [Quantization](../../quantization/overview) overview to learn more
```py ```py
import torch import torch
from diffusers import BitsAndBytesConfig as DiffusersBitsAndBytesConfig, SanaTransformer2DModel, SanaPipeline from diffusers import BitsAndBytesConfig as DiffusersBitsAndBytesConfig, SanaTransformer2DModel, SanaPipeline
from transformers import BitsAndBytesConfig as BitsAndBytesConfig, AutoModelForCausalLM from transformers import BitsAndBytesConfig as BitsAndBytesConfig, AutoModel
quant_config = BitsAndBytesConfig(load_in_8bit=True) quant_config = BitsAndBytesConfig(load_in_8bit=True)
text_encoder_8bit = AutoModelForCausalLM.from_pretrained( text_encoder_8bit = AutoModel.from_pretrained(
"Efficient-Large-Model/Sana_1600M_1024px_diffusers", "Efficient-Large-Model/Sana_1600M_1024px_diffusers",
subfolder="text_encoder", subfolder="text_encoder",
quantization_config=quant_config, quantization_config=quant_config,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment