Visual Reasoning Indexing and Retrieval Using In-Memory Computing

2016 ◽  
Vol 10 (03) ◽  
pp. 299-322 ◽  
Author(s):  
Hongfei Cao ◽  
Yu Li ◽  
Carla M. Allen ◽  
Michael A. Phinney ◽  
Chi-Ren Shyu

Research has shown that visual information of multimedia is critical in highly-skilled applications, such as biomedicine and life sciences, and a certain visual reasoning process is essential for meaningful search in a timely manner. Relevant image characteristics are learned and verified with accumulated experiences during the reasoning processes. However, such processes are highly dynamic and elusive to computationally quantify and therefore challenging to analyze, let alone to make the knowledge sharable across users. In this paper we study real-time human visual reasoning processes with the aid of gaze tracking devices. Temporal and spatial representations are proposed for gaze modeling, and a visual reasoning retrieval system utilizing in-memory computing under Big Data ecosystems is designed for real-time search of similar reasoning models. Simulated data derived from human subject experiments show that the system has a reasonably high accuracy and provides predictive estimations for hardware requirements versus data sizes for exhaustive searches. Comparison between various visual action classifiers show challenges in modeling visual actions. The proposed system provides a theoretical framework and computing platform for advancement in visual semantic computing, as well as potential applications in medicine, social science, and arts.

2014 ◽  
Vol 25 (4) ◽  
pp. 279-287 ◽  
Author(s):  
Stefan Hey ◽  
Panagiota Anastasopoulou ◽  
André Bideaux ◽  
Wilhelm Stork

Ambulatory assessment of emotional states as well as psychophysiological, cognitive and behavioral reactions constitutes an approach, which is increasingly being used in psychological research. Due to new developments in the field of information and communication technologies and an improved application of mobile physiological sensors, various new systems have been introduced. Methods of experience sampling allow to assess dynamic changes of subjective evaluations in real time and new sensor technologies permit a measurement of physiological responses. In addition, new technologies facilitate the interactive assessment of subjective, physiological, and behavioral data in real-time. Here, we describe these recent developments from the perspective of engineering science and discuss potential applications in the field of neuropsychology.


Molecules ◽  
2020 ◽  
Vol 26 (1) ◽  
pp. 20
Author(s):  
Reynaldo Villarreal-González ◽  
Antonio J. Acosta-Hoyos ◽  
Jaime A. Garzon-Ochoa ◽  
Nataly J. Galán-Freyle ◽  
Paola Amar-Sepúlveda ◽  
...  

Real-time reverse transcription (RT) PCR is the gold standard for detecting Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), owing to its sensitivity and specificity, thereby meeting the demand for the rising number of cases. The scarcity of trained molecular biologists for analyzing PCR results makes data verification a challenge. Artificial intelligence (AI) was designed to ease verification, by detecting atypical profiles in PCR curves caused by contamination or artifacts. Four classes of simulated real-time RT-PCR curves were generated, namely, positive, early, no, and abnormal amplifications. Machine learning (ML) models were generated and tested using small amounts of data from each class. The best model was used for classifying the big data obtained by the Virology Laboratory of Simon Bolivar University from real-time RT-PCR curves for SARS-CoV-2, and the model was retrained and implemented in a software that correlated patient data with test and AI diagnoses. The best strategy for AI included a binary classification model, which was generated from simulated data, where data analyzed by the first model were classified as either positive or negative and abnormal. To differentiate between negative and abnormal, the data were reevaluated using the second model. In the first model, the data required preanalysis through a combination of prepossessing. The early amplification class was eliminated from the models because the numbers of cases in big data was negligible. ML models can be created from simulated data using minimum available information. During analysis, changes or variations can be incorporated by generating simulated data, avoiding the incorporation of large amounts of experimental data encompassing all possible changes. For diagnosing SARS-CoV-2, this type of AI is critical for optimizing PCR tests because it enables rapid diagnosis and reduces false positives. Our method can also be used for other types of molecular analyses.


Author(s):  
Taizhi Lv ◽  
Jun Zhang ◽  
YingYing Chen ◽  
Chenyong He
Keyword(s):  

2021 ◽  
Author(s):  
Ryan Daher ◽  
Nesma Aldash

Abstract With the global push towards Industry 4.0, a number of leading companies and organizations have invested heavily in Industrial Internet of Things (IIOT's) and acquired a massive amount of data. But data without proper analysis that converts it into actionable insights is just more information. With the advancement of Data analytics, machine learning, artificial intelligence, numerous methods can be used to better extract value out of the amassed data from various IIOTs and leverage the analysis to better make decisions impacting efficiency, productivity, optimization and safety. This paper focuses on two case studies- one from upstream and one from downstream using RTLS (Real Time Location Services). Two types of challenges were present: the first one being the identification of the location of all personnel on site in case of emergency and ensuring that all have mustered in a timely fashion hence reducing the time to muster and lessening the risks of Leaving someone behind. The second challenge being the identification of personnel and various contractors, the time they entered in productive or nonproductive areas and time it took to complete various tasks within their crafts while on the job hence accounting for efficiency, productivity and cost reduction. In both case studies, advanced analytics were used, and data collection issues were encountered highlighting the need for further and seamless integration between data, analytics and intelligence is needed. Achievements from both cases were visible increase in productivity and efficiency along with the heightened safety awareness hence lowering the overall risk and liability of the operation. Novel/Additive Information: The results presented from both studies have highlighted other potential applications of the IIOT and its related analytics. Pertinent to COVID-19, new application of such approach was tested in contact tracing identifying workers who could have tested positive and tracing back to personnel that have been in close proximity and contact therefore reducing the spread of COVID. Other application of the IIOT and its related analytics has also been tested in crane, forklift and heavy machinery proximity alert reducing the risk of accidents.


Sign in / Sign up

Export Citation Format

Share Document