Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
bitsandbytes
Commits
57cfbcb7
Unverified
Commit
57cfbcb7
authored
Sep 03, 2023
by
John B Nelson
Committed by
GitHub
Sep 03, 2023
Browse files
FIX missing closing quote in README example
parent
18e827d6
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
57cfbcb7
...
@@ -38,7 +38,7 @@ python setup.py install
...
@@ -38,7 +38,7 @@ python setup.py install
```
python
```
python
from
transformers
import
AutoModelForCausalLM
from
transformers
import
AutoModelForCausalLM
model
=
AutoModelForCausalLM
.
from_pretrained
(
model
=
AutoModelForCausalLM
.
from_pretrained
(
'decapoda-research/llama-7b-hf,
'decapoda-research/llama-7b-hf
'
,
device_map
=
'auto'
,
device_map
=
'auto'
,
load_in_8bit
=
True
,
load_in_8bit
=
True
,
max_memory
=
f
'
{
int
(
torch
.
cuda
.
mem_get_info
()[
0
]
/
1024
**
3
)
-
2
}
GB'
)
max_memory
=
f
'
{
int
(
torch
.
cuda
.
mem_get_info
()[
0
]
/
1024
**
3
)
-
2
}
GB'
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment