scholarly journals Learning from minimum entropy queries in a large committee machine

1996 ◽  
Vol 53 (3) ◽  
pp. R2060-R2063 ◽  
Author(s):  
Peter Sollich
1992 ◽  
Vol 20 (4) ◽  
pp. 375-380 ◽  
Author(s):  
H Schwarze ◽  
J Hertz

1996 ◽  
Vol 8 (6) ◽  
pp. 1267-1276 ◽  
Author(s):  
R. Urbanczik

Statistical mechanics is used to study generalization in a tree committee machine with K hidden units and continuous weights trained on examples generated by a teacher of the same structure but corrupted by noise. The corruption is due to additive gaussian noise applied in the input layer or the hidden layer of the teacher. In the large K limit the generalization error εg as function of α, the number of patterns per adjustable parameter, shows a qualitatively similar behavior for the two cases: It does not approach its optimal value and is nonmonotonic if training is done at zero temperature. This remains true even when replica symmetry breaking is taken into account. Training at a fixed positive temperature leads, within the replica symmetric theory, to an α-k decay of εg toward its optimal value. The value of k is calculated and found to depend on the model of noise. By scaling the temperature with α, the value of k can be increased to an optimal value kopt. However, at one step of replica symmetry breaking at a fixed positive temperature εg decays as α−kopt. So, although εg will approach its optimal value with increasing sample size for any fixed K, the convergence is only uniform in K when training at a positive temperature.


2011 ◽  
Vol 33 (8) ◽  
pp. 1809-1815
Author(s):  
Gang Xu ◽  
Lei Yang ◽  
Lei Zhang ◽  
Ya-chao Li ◽  
Meng-dao Xing

2021 ◽  
Vol 11 (14) ◽  
pp. 6590
Author(s):  
Krittakom Srijiranon ◽  
Narissara Eiamkanitchat

Air pollution is a major global issue. In Thailand, this issue continues to increase every year, similar to other countries, especially during the dry season in the northern region. In this period, particulate matter with aerodynamic diameters smaller than 10 and 2.5 micrometers, known as PM10 and PM2.5, are important pollutants, most of which exceed the national standard levels, the so-called Thailand air quality index (T-AQI). Therefore, this study created a prediction model to classify T-AQI calculated from both types of PM. The neuro-fuzzy model with a minimum entropy principle model is proposed to transform the original data into new informative features. The processes in this model are able to discover appropriate separation points of the trapezoidal membership function by applying the minimum entropy principle. The membership value of the fuzzy section is then passed to the neural section to create a new data feature, the PM level, for each hour of the day. Finally, as an analytical process to obtain new knowledge, predictive models are created using new data features for better classification results. Various experiments were utilized to find an appropriate structure with high prediction accuracy. The results of the proposed model were favorable for predicting both types of PM up to three hours in advance. The proposed model can help people who are planning short-term outdoor activities.


2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Wei Xiong ◽  
Lei Zhou ◽  
Ling Yue ◽  
Lirong Li ◽  
Song Wang

AbstractBinarization plays an important role in document analysis and recognition (DAR) systems. In this paper, we present our winning algorithm in ICFHR 2018 competition on handwritten document image binarization (H-DIBCO 2018), which is based on background estimation and energy minimization. First, we adopt mathematical morphological operations to estimate and compensate the document background. It uses a disk-shaped structuring element, whose radius is computed by the minimum entropy-based stroke width transform (SWT). Second, we perform Laplacian energy-based segmentation on the compensated document images. Finally, we implement post-processing to preserve text stroke connectivity and eliminate isolated noise. Experimental results indicate that the proposed method outperforms other state-of-the-art techniques on several public available benchmark datasets.


Sign in / Sign up

Export Citation Format

Share Document