Skip to content

GitLab

Unverified Commit 095f7a56 authored by Tim Dettmers's avatar Tim Dettmers Committed by GitHub
Browse files

Merge pull request #744 from jbn/patch-1 

FIX missing closing quote in README example
parents f63abb5a 57cfbcb7
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 095f7a56
...@@ -38,7 +38,7 @@ python setup.py install ...@@ -38,7 +38,7 @@ python setup.py install
```python ```python
from transformers import AutoModelForCausalLM from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained( model = AutoModelForCausalLM.from_pretrained(
'decapoda-research/llama-7b-hf, 'decapoda-research/llama-7b-hf',
device_map='auto', device_map='auto',
load_in_8bit=True, load_in_8bit=True,
max_memory=f'{int(torch.cuda.mem_get_info()[0]/1024**3)-2}GB') max_memory=f'{int(torch.cuda.mem_get_info()[0]/1024**3)-2}GB')
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment