Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
5876ee95
Commit
5876ee95
authored
Aug 19, 2025
by
zhuwenwen
Browse files
remove conch-triton-kernels and skip AiterFlashAttentionMetadata
parent
185d5e7c
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
4 deletions
+4
-4
requirements/rocm.txt
requirements/rocm.txt
+1
-1
vllm/v1/spec_decode/eagle.py
vllm/v1/spec_decode/eagle.py
+3
-3
No files found.
requirements/rocm.txt
View file @
5876ee95
...
...
@@ -17,4 +17,4 @@ setuptools>=77.0.3,<80.0.0
setuptools-scm>=8
runai-model-streamer==0.11.0
runai-model-streamer-s3==0.11.0
conch-triton-kernels==1.2.1
#
conch-triton-kernels==1.2.1
vllm/v1/spec_decode/eagle.py
View file @
5876ee95
...
...
@@ -20,8 +20,8 @@ from vllm.model_executor.models.llama_eagle3 import Eagle3LlamaForCausalLM
from
vllm.platforms
import
current_platform
from
vllm.utils
import
is_pin_memory_available
from
vllm.v1.attention.backends.flash_attn
import
FlashAttentionMetadata
from
vllm.v1.attention.backends.rocm_aiter_fa
import
(
AiterFlashAttentionMetadata
)
#
from vllm.v1.attention.backends.rocm_aiter_fa import (
#
AiterFlashAttentionMetadata)
from
vllm.v1.attention.backends.tree_attn
import
(
TreeAttentionMetadata
,
TreeAttentionMetadataBuilder
)
from
vllm.v1.attention.backends.triton_attn
import
TritonAttentionMetadata
...
...
@@ -231,7 +231,7 @@ class EagleProposer:
if
current_platform
.
is_rocm
():
assert
isinstance
(
attn_metadata
,
(
TritonAttentionMetadata
,
AiterFlashAttentionMetadata
,
(
TritonAttentionMetadata
,
#
AiterFlashAttentionMetadata,
FlashAttentionMetadata
))
else
:
# Currently, only FlashAttention supports multi-token eagle spec
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment