Inherently Interpretable Sparse Word Embeddings through Sparse Coding

2020 ◽  
Author(s):  
Adly Templeton
Keyword(s):  
Sparse Coding ◽  
Word Embeddings

scholarly journals Linear Algebraic Structure of Word Senses, with Applications to Polysemy

2018 ◽  
Vol 6 ◽  
pp. 483-495 ◽  
Author(s):  
Sanjeev Arora ◽  
Yuanzhi Li ◽  
Yingyu Liang ◽  
Tengyu Ma ◽  
Andrej Risteski
Keyword(s):  
Information Retrieval ◽  
Random Walk ◽  
Algebraic Structure ◽  
Sparse Coding ◽  
Word Sense ◽  
Word Embeddings ◽  
Linear Superposition ◽  
Empirical Tests ◽  
Embedding Methods ◽  
Word Senses

Word embeddings are ubiquitous in NLP and information retrieval, but it is unclear what they represent when the word is polysemous. Here it is shown that multiple word senses reside in linear superposition within the word embedding and simple sparse coding can recover vectors that approximately capture the senses. The success of our approach, which applies to several embedding methods, is mathematically explained using a variant of the random walk on discourses model (Arora et al., 2016). A novel aspect of our technique is that each extracted word sense is accompanied by one of about 2000 “discourse atoms” that gives a succinct description of which other words co-occur with that word sense. Discourse atoms can be of independent interest, and make the method potentially more useful. Empirical tests are used to verify and support the theory.

Human Action Recognition Based on Discriminative Sparse Coding Video Representation

ROBOT ◽  
2012 ◽  
Vol 34 (6) ◽  
pp. 745 ◽  
Author(s):  
Bin WANG ◽  
Yuanyuan WANG ◽  
Wenhua XIAO ◽  
Wei WANG ◽  
Maojun ZHANG
Keyword(s):  
Action Recognition ◽  
Sparse Coding ◽  
Human Action Recognition ◽  
Human Action ◽  
Video Representation

Off-Topic Spoken Response Detection with Word Embeddings

2017 ◽  
Author(s):  
Su-Youn Yoon ◽  
Chong Min Lee ◽  
Ikkyu Choi ◽  
Xinhao Wang ◽  
Matthew Mulholland ◽  
...  
Keyword(s):  
Word Embeddings ◽  
Response Detection

Contextual Word Embeddings and Topic Modeling in Healthy Dieting and Obesity

2019 ◽  
Vol 3 (2) ◽  
pp. 159-183 ◽  
Author(s):  
Vijaya Kumari Yeruva ◽  
Sidrah Junaid ◽  
Yugyung Lee
Keyword(s):  
Topic Modeling ◽  
Word Embeddings
Sign in / Sign up

Export Citation Format

Share Document