Skip to content

GitLab

Commit aa6b01c6 authored by xuxzh1's avatar xuxzh1 🎱
Browse files

Update rocm.py

parent c5eae25b
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
server/text_generation_server/layers/attention/rocm.py
View file @ aa6b01c6
...@@ -114,6 +114,7 @@ def paged_attention( ...@@ -114,6 +114,7 @@ def paged_attention(
None, None,
"auto", "auto",
1.0, 1.0,
1.0
) )
else: else:
# Run PagedAttention V2. # Run PagedAttention V2.
...@@ -149,6 +150,7 @@ def paged_attention( ...@@ -149,6 +150,7 @@ def paged_attention(
None, None,
"auto", "auto",
1.0, 1.0,
1.0
) )
# else: # else:
# paged_attention_custom( # paged_attention_custom(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment