Norm of word embedding encodes information gain.

Momose Oyama Sho Yokoi Hidetoshi Shimodaira

Published in: CoRR (2022)

Keyphrases

information gain
document frequency
stop words
text categorization
decision trees
chi square
feature selection
mutual information
chi squared
n gram
vector space
correlation coefficient
naive bayes
co occurrence
occurrence frequency
keywords
learning algorithm
correlation based feature selection