Relational Restricted Boltzmann Machines: A Probabilistic Logic Learning Approach
Published in Twenty-Seventh International Conference on Inductive Logic Programming (ILP'17), Orleans, France, 2017
Recommended citation: N. Kaur, G. Kunapuli, T. Khot, K. Kersting, W. W. Cohen and S. Natarajan. Relational Restricted Boltzmann Machines: A Probabilistic Logic Learning Approach . Twenty-Seventh International Conference on Inductive Logic Programming (ILP'17), Orleans, France. http://gkunapuli.github.io/files/17rrbmILP.pdf
We consider the problem of learning Boltzmann machine classifiers from relational data. Our goal is to extend the deep belief framework of RBMs to statistical relational models. This allows one to exploit the feature hierarchies and the non-linearity inherent in RBMs over the rich representations used in statistical relational learning (SRL). Specifically, we use lifted random walks to generate features for predicates that are then used to construct the observed features in the RBM in a manner similar to Markov Logic Networks. We show empirically that this method of constructing an RBM is comparable or better than the state-of-the-art probabilistic relational learning algorithms on six relational domains.