Canonical Tensor Decomposition for Knowledge Base Completion

Timothée Lacroix (1, 2) , Nicolas Usunier (1) , Guillaume Obozinski (2)

1 FAIR - Facebook AI Research [Paris]
2 LIGM - Laboratoire d'Informatique Gaspard-Monge

The problem of Knowledge Base Completion can be framed as a 3rd-order binary tensor completion problem. In this light, the Canonical Tensor Decomposition (CP) (Hitchcock, 1927) seems like a natural solution; however, current implementations of CP on standard Knowledge Base Completion benchmarks are lagging behind their competitors. In this work, we attempt to understand the limits of CP for knowledge base completion. First, we motivate and test a novel regularizer, based on tensor nuclear p-norms. Then, we present a refor-mulation of the problem that makes it invariant to arbitrary choices in the inclusion of predicates or their reciprocals in the dataset. These two methods combined allow us to beat the current state of the art on several datasets with a CP decomposition , and obtain even better results using the more advanced ComplEx model.

Domains: Machine Learning [stat.ML]

Timothée Lacroix, Nicolas Usunier, Guillaume Obozinski. Canonical Tensor Decomposition for Knowledge Base Completion. Proceedings of the 35th International Conference on Machine Learning, In press. ⟨hal-01817595⟩