Support for variable sharding / distributed inference?


#1

Does Edward support sharding of the random variables and distributed inference? For example in LDA, one can imagine the word-topic matrix might not fit on a single machine if the number of topics/vocabulary is large.


#2

Edward is at the same abstraction level as TensorFlow. So I recommend looking into Distributed TensorFlow, which is perfectly compatible.