"vscode:/vscode.git/clone" did not exist on "9bfb3e9ec3f7dcf9124ba43dba0a21344eb4197d"
Unverified Commit 7eb3ba82 authored by Johannes Kolbe's avatar Johannes Kolbe Committed by GitHub
Browse files

remove quotes in code example (#29812)


Co-authored-by: default avatarJohannes <johannes.kolbe@tech.better.team>
parent e3e16ddc
......@@ -107,7 +107,7 @@ from transformers import LlavaNextForConditionalGeneration, BitsAndBytesConfig
quantization_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype="torch.float16",
bnb_4bit_compute_dtype=torch.float16,
)
model = LlavaNextForConditionalGeneration.from_pretrained("llava-hf/llava-v1.6-mistral-7b-hf", quantization_config=quantization_config, device_map="auto")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment