Entropy Principle

2002 ◽  
pp. 129-151
Author(s):  
I-Shih Liu
Keyword(s):  
Entropy Principle

Probability distribution estimation for Web service QoS based on max entropy principle

2013 ◽  
Vol 32 (10) ◽  
pp. 2728-2731
Author(s):  
Zhi-hua DAI ◽  
Xiao-dong FU ◽  
Yuan HUANG ◽  
Nan JIA
Keyword(s):  
Probability Distribution ◽  
Web Service ◽  
Distribution Estimation ◽  
Entropy Principle

Experimental Validation of Minimax Entropy Principle in Ultrasound Images

2019 ◽  
Vol 12 (6) ◽  
pp. 487-493
Author(s):  
Neha Mehta ◽  
Svav Prasad ◽  
Leena Arya
Keyword(s):  
Region Of Interest ◽  
Ultrasound Images ◽  
Human Gallbladder ◽  
New Approach ◽  
Non Invasive ◽  
Entropy Principle ◽  
Significant Performance ◽  
Considerable Impact ◽  
Ultrasonic Devices ◽  
Measure Of Uncertainty

Ultrasound imaging is one of the non-invasive imaging, that diagnoses the disease inside a human body and there are numerous ultrasonic devices being used frequently. Entropy as a well known statistical measure of uncertainty has a considerable impact on the medical images. A procedure for minimizing the entropy with respect to the region of interest is demonstrated. This new approach has shown the experiments using Extracted Region Of Interest Based Sharpened image, called as (EROIS) image based on Minimax entropy principle and various filters. In this turn, the approach also validates the versatility of the entropy concept. Experiments have been performed practically on the real-time ultrasound images collected from ultrasound centers and have shown a significant performance. The present approach has been validated with showing results over ultrasound images of the Human Gallbladder.

scholarly journals Neuro-Fuzzy Transformation with Minimize Entropy Principle to Create New Features for Particulate Matter Prediction

2021 ◽  
Vol 11 (14) ◽  
pp. 6590
Author(s):  
Krittakom Srijiranon ◽  
Narissara Eiamkanitchat
Keyword(s):  
Particulate Matter ◽  
Fuzzy Model ◽  
Original Data ◽  
Northern Region ◽  
National Standard ◽  
Minimum Entropy ◽  
Fuzzy Transformation ◽  
Neuro Fuzzy ◽  
Proposed Model ◽  
Entropy Principle

Air pollution is a major global issue. In Thailand, this issue continues to increase every year, similar to other countries, especially during the dry season in the northern region. In this period, particulate matter with aerodynamic diameters smaller than 10 and 2.5 micrometers, known as PM10 and PM2.5, are important pollutants, most of which exceed the national standard levels, the so-called Thailand air quality index (T-AQI). Therefore, this study created a prediction model to classify T-AQI calculated from both types of PM. The neuro-fuzzy model with a minimum entropy principle model is proposed to transform the original data into new informative features. The processes in this model are able to discover appropriate separation points of the trapezoidal membership function by applying the minimum entropy principle. The membership value of the fuzzy section is then passed to the neural section to create a new data feature, the PM level, for each hour of the day. Finally, as an analytical process to obtain new knowledge, predictive models are created using new data features for better classification results. Various experiments were utilized to find an appropriate structure with high prediction accuracy. The results of the proposed model were favorable for predicting both types of PM up to three hours in advance. The proposed model can help people who are planning short-term outdoor activities.

An entropy concentration theorem: applications in artificial intelligence and descriptive statistics

1990 ◽  
Vol 27 (2) ◽  
pp. 303-313 ◽  
Author(s):  
Claudine Robert
Keyword(s):  
Artificial Intelligence ◽  
Maximum Entropy ◽  
Large Deviation ◽  
Maximum Entropy Principle ◽  
Statistical Modelling ◽  
Linear Constraints ◽  
Descriptive Statistics ◽  
Entropy Principle ◽  
Maximum Entropy Distribution ◽  
Mathematical Justification

The maximum entropy principle is used to model uncertainty by a maximum entropy distribution, subject to some appropriate linear constraints. We give an entropy concentration theorem (whose demonstration is based on large deviation techniques) which is a mathematical justification of this statistical modelling principle. Then we indicate how it can be used in artificial intelligence, and how relevant prior knowledge is provided by some classical descriptive statistical methods. It appears furthermore that the maximum entropy principle yields to a natural binding between descriptive methods and some statistical structures.

SINE ENTROPY FOR UNCERTAIN VARIABLES

2013 ◽  
Vol 21 (05) ◽  
pp. 743-753 ◽  
Author(s):  
KAI YAO ◽  
JINWU GAO ◽  
WEI DAI
Keyword(s):  
Maximum Entropy ◽  
Uncertainty Theory ◽  
Maximum Entropy Principle ◽  
Expected Value ◽  
Uncertain Variables ◽  
Entropy Principle

Entropy is a measure of the uncertainty associated with a variable whose value cannot be exactly predicated. In uncertainty theory, it has been quantified so far by logarithmic entropy. However, logarithmic entropy sometimes fails to measure the uncertainty. This paper will propose another type of entropy named sine entropy as a supplement, and explore its properties. After that, the maximum entropy principle will be introduced, and the arc-cosine distributed variables will be proved to have the maximum sine entropy with given expected value and variance.

Sign in / Sign up

Export Citation Format

Share Document