Skip to content

GitLab

"test/ut/vscode:/vscode.git/clone" did not exist on "9fde0e8e003d894003ebafa5a30160f5fb9dc2c2"
Unverified Commit 14fc1a24 authored by Kirill's avatar Kirill Committed by GitHub
Browse files

Fix quantization docs typo (#22666)

parent 3876fc68
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
docs/source/en/main_classes/quantization.mdx
View file @ 14fc1a24
...@@ -33,7 +33,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer ...@@ -33,7 +33,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "bigscience/bloom-1b7" model_id = "bigscience/bloom-1b7"
tokenizer = AutoTokenizer.from_pretrained(model_id) tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map == "auto", load_in_8bit=True) model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto", load_in_8bit=True)
``` ```
Then, use your model as you would usually use a [`PreTrainedModel`]. Then, use your model as you would usually use a [`PreTrainedModel`].
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment