Minor cleanup in `projects/mobilebert/distillation.py`.

PiperOrigin-RevId: 367244904

Minor cleanup in `projects/mobilebert/distillation.py`.
PiperOrigin-RevId: 367244904
9e3550e5 · A. Unique TensorFlower · 417aa073 · 9e3550e5
Commit 9e3550e5 authored Apr 07, 2021 by A. Unique TensorFlower
Hide whitespace changes
Inline Side-by-side

Showing with 0 additions and 1 deletion

official/nlp/projects/mobilebert/distillation.py official/nlp/projects/mobilebert/distillation.py +0 -1

No files found.
--- a/official/nlp/projects/mobilebert/distillation.py
+++ b/official/nlp/projects/mobilebert/distillation.py
@@ -378,7 +378,6 @@ class BertDistillationTask(policies.ProgressivePolicy, base_task.Task):
      # Shape: [batch, max_predictions_per_seq, vocab_size]
      lm_label = tf.one_hot(indices=lm_label, depth=vocab_size, on_value=1.0,
                            off_value=0.0, axis=-1, dtype=tf.float32)
-      lm_label_weights = labels['masked_lm_weights']
      gt_ratio = distill_config.distill_ground_truth_ratio
      if gt_ratio != 1.0:
        teacher_mlm_logits = outputs['teacher_pretrainer_output']['mlm_logits']