Fix KL when num_classes != 2

Fix to [issue 1724](https://github.com/tensorflow/models/issues/1724)

Fix KL when num_classes != 2
Fix to [issue 1724](https://github.com/tensorflow/models/issues/1724)
6f38af5f · Ryan Sepassi · GitHub · 6685fb8b · 6f38af5f
Commit 6f38af5f authored Jun 29, 2017 by Ryan Sepassi Committed by GitHub Jun 29, 2017
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

adversarial_text/adversarial_losses.py adversarial_text/adversarial_losses.py +1 -0

No files found.
--- a/adversarial_text/adversarial_losses.py
+++ b/adversarial_text/adversarial_losses.py
@@ -212,6 +212,7 @@ def _kl_divergence_with_logits(q_logits, p_logits, weights):

  # For softmax regression
  else:
+    q = tf.nn.softmax(q_logits)
    kl = tf.reduce_sum(
        q * (tf.nn.log_softmax(q_logits) - tf.nn.log_softmax(p_logits)), 1)