Skip to content

GitLab

Commit 6b4a4821 authored by Tri Dao's avatar Tri Dao
Browse files

[FA] Remove unused variable rng_engine_inputs

parent 78b7a1dc
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
csrc/flash_attn/fmha_api.cpp
View file @ 6b4a4821
...@@ -309,7 +309,6 @@ mha_fwd(const at::Tensor &q, // total_q x num_heads x head_size, total_q ...@@ -309,7 +309,6 @@ mha_fwd(const at::Tensor &q, // total_q x num_heads x head_size, total_q
// state // state
// We use a custom RNG that increases the offset by batch_size * nheads * 32. // We use a custom RNG that increases the offset by batch_size * nheads * 32.
int64_t counter_offset = launch_params.params.b * launch_params.params.h * 32; int64_t counter_offset = launch_params.params.b * launch_params.params.h * 32;
at::PhiloxCudaState rng_engine_inputs;
if( is_dropout ) { if( is_dropout ) {
// See Note [Acquire lock when using random generators] // See Note [Acquire lock when using random generators]
...@@ -612,7 +611,6 @@ mha_fwd_block(const at::Tensor &q, // total_q x num_heads x head_size, t ...@@ -612,7 +611,6 @@ mha_fwd_block(const at::Tensor &q, // total_q x num_heads x head_size, t
// number of times random will be generated per thread, to offset philox counter in thc random // number of times random will be generated per thread, to offset philox counter in thc random
// state // state
int64_t counter_offset = launch_params.elts_per_thread; int64_t counter_offset = launch_params.elts_per_thread;
at::PhiloxCudaState rng_engine_inputs;
if( is_dropout ) { if( is_dropout ) {
// See Note [Acquire lock when using random generators] // See Note [Acquire lock when using random generators]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment