Fix KL when num_classes != 2 (#1820)

Fix to [issue 1724](https://github.com/tensorflow/models/issues/1724)

Fix KL when num_classes != 2 (#1820)
Fix to [issue 1724](https://github.com/tensorflow/models/issues/1724)
d7d87e3d · Ryan Sepassi · GitHub · 6685fb8b · d7d87e3d
Commit d7d87e3d authored Jun 29, 2017 by Ryan Sepassi Committed by GitHub Jun 29, 2017
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

adversarial_text/adversarial_losses.py adversarial_text/adversarial_losses.py +1 -0

No files found.
--- a/adversarial_text/adversarial_losses.py
+++ b/adversarial_text/adversarial_losses.py
@@ -212,6 +212,7 @@ def _kl_divergence_with_logits(q_logits, p_logits, weights):
  # For softmax regression
  else:
+    q = tf.nn.softmax(q_logits)
    kl = tf.reduce_sum(
        q * (tf.nn.log_softmax(q_logits) - tf.nn.log_softmax(p_logits)), 1)