Unverified Commit 671261c3 authored by nateanl's avatar nateanl Committed by GitHub
Browse files

Fix wavlm bundles (#3660)

The `encoder_layer_norm_first` should be set to True for the Large model of WavLM.
Address https://github.com/pytorch/audio/issues/3347
parent 0b6ca28d
......@@ -1350,7 +1350,7 @@ WAVLM_LARGE = Wav2Vec2Bundle(
"encoder_ff_interm_features": 4096,
"encoder_ff_interm_dropout": 0.0,
"encoder_dropout": 0.1,
"encoder_layer_norm_first": False,
"encoder_layer_norm_first": True,
"encoder_layer_drop": 0.05,
"aux_num_out": None,
},
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment