Publication
Effectively Creating Weakly Labeled Training Examples via Approximate Domain Knowledge
Sriraam Natarajan; Jose Picado; Tushar Khot; Kristian Kersting; Christopher Ré; Jude W. Shavlik
In: Jesse Davis; Jan Ramon (Hrsg.). Inductive Logic Programming - 24th International Conference. International Conference on Inductive Logic Programming (ILP-2014), September 14-16, Nancy, France, Pages 92-107, Lecture Notes in Computer Science, Vol. 9046, Springer, 2014.
Abstract
One of the challenges to information extraction is the requirement of human annotated examples, commonly called gold-standard examples. Many successful approaches alleviate this problem by employing some form of distant supervision, i.e., look into knowledge bases such as Freebase as a source of supervision to create more examples. While this is perfectly reasonable, most distant supervision methods rely on a hand-coded background knowledge that explicitly looks for patterns in text. For example, they assume all sentences containing Person X and Person Y are positive examples of the relation . In this work, we take a different approach – we infer weakly supervised examples for relations from models learned by using knowledge outside the natural language task. We argue that this method creates more robust examples that are particularly useful when learning the entire information-extraction model (the structure and parameters). We demonstrate on three domains that this form of weak supervision yields superior results when learning structure compared to using distant supervision labels or a smaller set of gold-standard labels.