KLqp with Beta/Bernoulli (Coin Flip example)

[Focus]

You have a typo. tf.nn.softmax will is 1 for every tensor of size [1]. You need to use tf.nn.softplus.