Louis-Philippe Morency, Xu Sun, Daisuke Okanoharay, Jun’ichi Tsujii: “Modeling Latent-Dynamic in Shallow Parsing: A Latent Conditional Model with Improved Inference”

August 18, 2008 | Manchester, UK

Speaker: Louis-Philippe Morency, Xu Sun, Daisuke Okanoharay, Jun'ichi Tsujii
Host: The 22nd International Conference on Computational Linguistics (COLING 2008)

Shallow parsing is one of many NLP tasks that can be reduced to a sequence labeling problem. In this paper we show that the latent-dynamics (i.e., hidden substructure of shallow phrases) constitutes a problem in shallow parsing, and we show that modeling this intermediate structure is useful. By analyzing the automatically learned hidden states, we show how the latent conditional model explicitly learn latent-dynamics. We propose in this paper the Best Label Path (BLP) inference algorithm, which is able to produce the most probable label sequence on latent conditional models. It outperforms two existing inference algorithms. With the BLP inference, the LDCRF model significantly outperforms CRF models on word features, and achieves comparable performance of the most successful shallow parsers on the CoNLL data when further using part-ofspeech features.