Publication
Discriminative Non-Parametric Learning of Arithmetic Circuits
Nandini Ramanan; Mayukh Das; Kristian Kersting; Sriraam Natarajan
In: Manfred Jaeger; Thomas Dyhre Nielsen (Hrsg.). Proceedings of the 10th International Conference on Probabilistic Graphical Models. International Conference on Probabilistic Graphical Models (PGM-2020), September 23-25, Aalborg, Denmark, Pages 353-364, Proceedings of Machine Learning Research, Vol. 138, PMLR, 2020.
Abstract
Arithmetic Circuits (AC) and Sum-Product Networks (SPN) have recently gained significant interest by virtue of being tractable deep probabilistic models. We propose the first gradient-boosted method for structure learning of discriminative ACs (DACs), called DACBOOST. In discrete domains ACs are essentially equivalent to mixtures of trees, thus DACBOOST decomposes a large AC into smaller tree-structured ACs and learns them in sequential, additive manner. The resulting non-parametric manner of learning DACs results in a model with very few tuning parameters making our learned model significantly more efficient. We demonstrate on standard data sets and real data sets, efficiency of DACBOOST compared to state-of-the-art DAC learners without sacrificing effectiveness.