Pointwise Prediction for Robust, Adaptable Japanese Morphological Analysis

Graham Neubig,  Yosuke Nakata,  Shinsuke Mori
Kyoto University


Abstract

We present a pointwise approach to Japanese morphological analysis (MA) that ignores structure information during learning and tagging. Despite the lack of structure, it is able to outperform the current state-of-the-art structured approach for Japanese MA, and achieves accuracy similar to that of structured predictors using the same feature set. We also find that the method is both robust to out-of-domain data, and can be easily adapted through the use of a combination of partial annotation and active learning.




Full paper: http://www.aclweb.org/anthology/P/P11/P11-2093.pdf