Abstract
Expressions, such as add fuel to the fire, can be interpreted literally or idiomatically depending on the context they occur in. Many Natural Language Processing applications could improve their performance if idiom recognition were improved. Our approach is based on the idea that idioms violate cohesive ties in local contexts, while literal expressions do not. We propose two approaches: 1) Compute inner product of context word vectors with the vector representing a target expression. Since literal vectors predict well local contexts, their inner product with contexts should be larger than idiomatic ones, thereby telling apart literals from idioms; and (2) Compute literal and idiomatic scatter (covariance) matrices from local contexts in word vector space. Since the scatter matrices represent context distributions, we can then measure the difference between the distributions using the Frobenius norm. For comparison, we implement Fazly et al. (2009)'s, Sporleder and Li (2009)'s, and Li and Sporleder (2010b)'s methods and apply them to our data. We provide experimental results validating the proposed techniques.
Original language | English |
---|---|
Pages (from-to) | 96-102 |
Number of pages | 7 |
Journal | CEUR Workshop Proceedings |
Volume | 1743 |
State | Published - 2016 |
Event | 3rd Annual International Symposium on Information Management and Big Data, SIMBig 2016 - Cusco, Peru Duration: 1 Sep 2016 → 3 Sep 2016 |