Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
0afa5071
"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "f99f2fb6618b20ff2c290ba23e182a5ac1ac000a"
Unverified
Commit
0afa5071
authored
Sep 01, 2023
by
Nino Risteski
Committed by
GitHub
Sep 01, 2023
Browse files
Update model_memory_anatomy.md (#25896)
typo fixes
parent
a4dd53d8
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
docs/source/en/model_memory_anatomy.md
docs/source/en/model_memory_anatomy.md
+2
-2
No files found.
docs/source/en/model_memory_anatomy.md
View file @
0afa5071
...
...
@@ -76,7 +76,7 @@ GPU memory occupied: 0 MB.
That looks good: the GPU memory is not occupied as we would expect before we load any models. If that's not the case on
your machine make sure to stop all processes that are using GPU memory. However, not all free GPU memory can be used by
the user. When a model is loaded to the GPU
also
the kernels are loaded which can take up 1-2GB of memory. To see how
the user. When a model is loaded to the GPU the kernels are
also
loaded
,
which can take up 1-2GB of memory. To see how
much it is we load a tiny tensor into the GPU which triggers the kernels to be loaded as well.
```
py
...
...
@@ -105,7 +105,7 @@ how much space just the weights use.
GPU
memory
occupied
:
2631
MB
.
```
We can see that the model weights alone take up 1.3 GB of
the
GPU memory. The exact number depends on the specific
We can see that the model weights alone take up 1.3 GB of GPU memory. The exact number depends on the specific
GPU you are using. Note that on newer GPUs a model can sometimes take up more space since the weights are loaded in an
optimized fashion that speeds up the usage of the model. Now we can also quickly check if we get the same result
as with
`nvidia-smi`
CLI:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment