Does Edward support sharding of the random variables and distributed inference? For example in LDA, one can imagine the word-topic matrix might not fit on a single machine if the number of topics/vocabulary is large.
Edward is at the same abstraction level as TensorFlow. So I recommend looking into Distributed TensorFlow, which is perfectly compatible.