Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
27a7b070
Unverified
Commit
27a7b070
authored
Mar 04, 2024
by
Jialun Lyu
Committed by
GitHub
Mar 04, 2024
Browse files
Add document for vllm paged attention kernel. (#2978)
parent
901cf4c5
Changes
9
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
9 changed files
with
526 additions
and
0 deletions
+526
-0
docs/source/assets/kernel/k_vecs.png
docs/source/assets/kernel/k_vecs.png
+0
-0
docs/source/assets/kernel/key.png
docs/source/assets/kernel/key.png
+0
-0
docs/source/assets/kernel/logits_vec.png
docs/source/assets/kernel/logits_vec.png
+0
-0
docs/source/assets/kernel/q_vecs.png
docs/source/assets/kernel/q_vecs.png
+0
-0
docs/source/assets/kernel/query.png
docs/source/assets/kernel/query.png
+0
-0
docs/source/assets/kernel/v_vec.png
docs/source/assets/kernel/v_vec.png
+0
-0
docs/source/assets/kernel/value.png
docs/source/assets/kernel/value.png
+0
-0
docs/source/dev/kernel/paged_attention.rst
docs/source/dev/kernel/paged_attention.rst
+525
-0
docs/source/index.rst
docs/source/index.rst
+1
-0
No files found.
docs/source/assets/kernel/k_vecs.png
0 → 100644
View file @
27a7b070
27 KB
docs/source/assets/kernel/key.png
0 → 100644
View file @
27a7b070
109 KB
docs/source/assets/kernel/logits_vec.png
0 → 100644
View file @
27a7b070
17.1 KB
docs/source/assets/kernel/q_vecs.png
0 → 100644
View file @
27a7b070
41.1 KB
docs/source/assets/kernel/query.png
0 → 100644
View file @
27a7b070
31.9 KB
docs/source/assets/kernel/v_vec.png
0 → 100644
View file @
27a7b070
50.1 KB
docs/source/assets/kernel/value.png
0 → 100644
View file @
27a7b070
119 KB
docs/source/dev/kernel/paged_attention.rst
0 → 100644
View file @
27a7b070
This diff is collapsed.
Click to expand it.
docs/source/index.rst
View file @
27a7b070
...
@@ -98,6 +98,7 @@ Documentation
...
@@ -98,6 +98,7 @@ Documentation
:caption: Developer Documentation
:caption: Developer Documentation
dev/engine/engine_index
dev/engine/engine_index
dev/kernel/paged_attention
Indices and tables
Indices and tables
==================
==================
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment