Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
71d21c73
Unverified
Commit
71d21c73
authored
Sep 26, 2024
by
Tyler Michael Smith
Committed by
GitHub
Sep 26, 2024
Browse files
[Bugfix] Fixup advance_step.cu warning (#8815)
parent
ee2da3e9
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
csrc/prepare_inputs/advance_step.cu
csrc/prepare_inputs/advance_step.cu
+2
-2
No files found.
csrc/prepare_inputs/advance_step.cu
View file @
71d21c73
...
...
@@ -211,7 +211,7 @@ void advance_step_flashinfer(
printf
(
" num_seqs = %d
\n
"
,
num_seqs
);
printf
(
" num_queries = %d
\n
"
,
num_queries
);
printf
(
" block_size = %d
\n
"
,
block_size
);
printf
(
" block_tables.stride(0) = %
d
\n
"
,
block_tables
.
stride
(
0
));
printf
(
" block_tables.stride(0) = %
zu
\n
"
,
block_tables
.
stride
(
0
));
}
// Verify all tensors
verify_tensor
(
"input_tokens"
,
input_tokens
,
num_seqs
,
-
1
,
at
::
kLong
);
...
...
@@ -303,4 +303,4 @@ void advance_step_flashinfer(
num_seqs
,
num_queries
,
block_size
,
input_tokens
,
sampled_token_ids
,
input_positions
,
seq_lens
,
slot_mapping
,
block_tables
,
paged_kv_indices
,
paged_kv_indptr
,
paged_kv_last_page_len
,
block_table_bound
);
}
\ No newline at end of file
}
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment