scholarly journals Chinese text classification method using FastText and term frequency-inverse document frequency optimization

2020 ◽  
Vol 1693 ◽  
pp. 012121
Author(s):  
Tiantian Zhou ◽  
Yintong Wang ◽  
Xin Zheng
Keyword(s):  
Chinese Text ◽  
Text Classification ◽  
Classification Method ◽  
Inverse Document Frequency ◽  
Term Frequency ◽  
Chinese Text Classification ◽  
Document Frequency ◽  
Frequency Optimization

An Improved TFIDF Algorithm in Text Classification

2014 ◽  
Vol 651-653 ◽  
pp. 2258-2261 ◽  
Author(s):  
Dong Dong Xu ◽  
Shao Bo Wu
Keyword(s):  
Information Retrieval ◽  
Text Classification ◽  
Cross Validation ◽  
Improved Method ◽  
Inverse Document Frequency ◽  
Term Frequency ◽  
Document Frequency ◽  
Fold Cross Validation

Term frequency/inverse document frequency (TF-IDF) is widely used in text classification at present, which is borrowed from Information Retrieval. Based on this conventional classical TF-IDF formula, we present a new TF-IDF weight schemes named CTF-IDF. The experiment shows that the improved method is feasible and effective. Furthermore, from the subsequent evaluations using 10-fold cross-validation, we can see the CTF-IDF greatly improves the accuracy of text classification.

Sign in / Sign up

Export Citation Format

Share Document