Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8fa7357f
Unverified
Commit
8fa7357f
authored
Mar 16, 2024
by
laneeee
Committed by
GitHub
Mar 15, 2024
Browse files
fix document error for value and v_vec illustration (#3421)
parent
a7af4538
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
1 addition
and
1 deletion
+1
-1
docs/source/assets/kernel/v_vec.png
docs/source/assets/kernel/v_vec.png
+0
-0
docs/source/assets/kernel/value.png
docs/source/assets/kernel/value.png
+0
-0
docs/source/dev/kernel/paged_attention.rst
docs/source/dev/kernel/paged_attention.rst
+1
-1
No files found.
docs/source/assets/kernel/v_vec.png
View replaced file @
a7af4538
View file @
8fa7357f
50.1 KB
|
W:
|
H:
41.5 KB
|
W:
|
H:
2-up
Swipe
Onion skin
docs/source/assets/kernel/value.png
View replaced file @
a7af4538
View file @
8fa7357f
119 KB
|
W:
|
H:
167 KB
|
W:
|
H:
2-up
Swipe
Onion skin
docs/source/dev/kernel/paged_attention.rst
View file @
8fa7357f
...
@@ -447,7 +447,7 @@ Value
...
@@ -447,7 +447,7 @@ Value
a whole block of value tokens. And each ``accs`` in each thread
a whole block of value tokens. And each ``accs`` in each thread
contains 8 elements that accumulated at 8 different head positions.
contains 8 elements that accumulated at 8 different head positions.
For the thread 0, the ``accs`` variable will have 8 elements, which
For the thread 0, the ``accs`` variable will have 8 elements, which
are 0th,
16
th …
112
th elements of a value head that are accumulated
are 0th,
32
th …
224
th elements of a value head that are accumulated
from all assigned 8 tokens.
from all assigned 8 tokens.
LV
LV
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment