Publication
Fisher Kernels for Logical Sequences
Kristian Kersting; Thomas Gärtner
In: Jean-François Boulicaut; Floriana Esposito; Fosca Giannotti; Dino Pedreschi (Hrsg.). Machine Learning: ECML 2004, 15th European Conference on Machine Learning, Proceedings. European Conference on Machine Learning (ECML-2004), September 20-24, Pisa, Italy, Pages 205-216, Lecture Notes in Computer Science (LNCS), Vol. 3201, Springer, 2004.
Abstract
One approach to improve the accuracy of classifications based on generative models is to combine them with successful discriminative algorithms. Fisher kernels were developed to combine generative models with a currently very popular class of learning algorithms, kernel methods. Empirically, the combination of hidden Markov models with support vector machines has shown promising results. So far, however, Fisher kernels have only been considered for sequences over flat alphabets. This is mostly due to the lack of a method for computing the gradient of a generative model over structured sequences. In this paper, we show how to compute the gradient of , which allow for the modelling of logical sequences, i.e., sequences over an alphabet of logical atoms. Experiments show a considerable improvement over results achieved without Fisher kernels for logical sequences.