scholarly journals Improvement of deep cross-modal retrieval by generating real-valued representation

2021 ◽  
Vol 7 ◽  
pp. e491
Author(s):  
Nikita Bhatt ◽  
Amit Ganatra
Keyword(s):  
State Of The Art ◽  
Representation Learning ◽  
Training Model ◽  
Performance Measure ◽  
Text And Image ◽  
Average Precision ◽  
Common Solution ◽  
The Core ◽  
The Mean ◽  
Image Modality

The cross-modal retrieval (CMR) has attracted much attention in the research community due to flexible and comprehensive retrieval. The core challenge in CMR is the heterogeneity gap, which is generated due to different statistical properties of multi-modal data. The most common solution to bridge the heterogeneity gap is representation learning, which generates a common sub-space. In this work, we propose a framework called “Improvement of Deep Cross-Modal Retrieval (IDCMR)”, which generates real-valued representation. The IDCMR preserves both intra-modal and inter-modal similarity. The intra-modal similarity is preserved by selecting an appropriate training model for text and image modality. The inter-modal similarity is preserved by reducing modality-invariance loss. The mean average precision (mAP) is used as a performance measure in the CMR system. Extensive experiments are performed, and results show that IDCMR outperforms over state-of-the-art methods by a margin 4% and 2% relatively with mAP in the text to image and image to text retrieval tasks on MSCOCO and Xmedia dataset respectively.

scholarly journals Investigation of optimal configurations of a convolutional neural network for the identification of objects in real-time

2019 ◽  
pp. 417-423
Author(s):  
M A Isayev ◽  
D A Savelyev
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Real Time ◽  
State Of The Art ◽  
Average Precision ◽  
The Core ◽  
Particular Solution ◽  
Optimal Configurations

The comparison of different convolutional neural networks which are the core of the most actual solutions in the computer vision area is considers in hhe paper. The study includes benchmarks of this state-of-the-art solutions by some criteria, such as mAP (mean average precision), FPS (frames per seconds), for the possibility of real-time usability. It is concluded on the best convolutional neural network model and deep learning methods that were used at particular solution.

Improving Document Retrieval with Spelling Correction for Weak and Fabricated Indonesian-Translated Hadith

2020 ◽  
Vol 4 (3) ◽  
pp. 551-557
Author(s):  
Muhammad zaky ramadhan ◽  
Kemas Muslim Lhaksmana
Keyword(s):  
Retrieval System ◽  
Islamic Law ◽  
Vector Space Model ◽  
Document Retrieval ◽  
The Internet ◽  
Average Precision ◽  
Spelling Correction ◽  
Space Model ◽  
The Mean ◽  
The Web

Hadith has several levels of authenticity, among which are weak (dhaif), and fabricated (maudhu) hadith that may not originate from the prophet Muhammad PBUH, and thus should not be considered in concluding an Islamic law (sharia). However, many such hadiths have been commonly confused as authentic hadiths among ordinary Muslims. To easily distinguish such hadiths, this paper proposes a method to check the authenticity of a hadith by comparing them with a collection of fabricated hadiths in Indonesian. The proposed method applies the vector space model and also performs spelling correction using symspell to check whether the use of spelling check can improve the accuracy of hadith retrieval, because it has never been done in previous works and typos are common on Indonesian-translated hadiths on the Web and social media raw text. The experiment result shows that the use of spell checking improves the mean average precision and recall to become 81% (from 73%) and 89% (from 80%), respectively. Therefore, the improvement in accuracy by implementing spelling correction make the hadith retrieval system more feasible and encouraged to be implemented in future works because it can correct typos that are common in the raw text on the Internet.

Pencarian Question-Answer Menggunakan Convolutional Neural Network Pada Topik Agama Berbahasa Indonesia

2018 ◽  
Vol 10 (1) ◽  
pp. 57-64 ◽  
Author(s):  
Rizqa Raaiqa Bintana ◽  
Chastine Fatichah ◽  
Diana Purwitasari
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Question Answering ◽  
Mean Average Precision ◽  
Average Precision ◽  
Community Based ◽  
Network Methods ◽  
The Mean ◽  
Index Terms ◽  
Search Information

Community-based question answering (CQA) is formed to help people who search information that they need through a community. One condition that may occurs in CQA is when people cannot obtain the information that they need, thus they will post a new question. This condition can cause CQA archive increased because of duplicated questions. Therefore, it becomes important problems to find semantically similar questions from CQA archive towards a new question. In this study, we use convolutional neural network methods for semantic modeling of sentence to obtain words that they represent the content of documents and new question. The result for the process of finding the same question semantically to a new question (query) from the question-answer documents archive using the convolutional neural network method, obtained the mean average precision value is 0,422. Whereas by using vector space model, as a comparison, obtained mean average precision value is 0,282. Index Terms—community-based question answering, convolutional neural network, question retrieval

Evaluation of Road Utilisation as Space For Holding Social Ceremonies in Indigenous Residential Area of Ogbomoso, Nigeria

2018 ◽  
Vol 1 (March 2018) ◽  
Author(s):  
S.A Okanlawon ◽  
O.O Odunjo ◽  
S.A Olaniyan
Keyword(s):  
Transport Infrastructure ◽  
Noisy Environment ◽  
Policy Makers ◽  
The Core ◽  
Local Roads ◽  
Strict Enforcement ◽  
The Mean ◽  
The One ◽  
The City ◽  
The Town

This study examined Residents’ evaluation of turning transport infrastructure (road) to spaces for holding social ceremonies in the indigenous residential zone of Ogbomoso, Oyo State, Nigeria. Upon stratifying the city into the three identifiable zones, the core, otherwise known as the indigenous residential zone was isolated for study. Of the twenty (20) political wards in the two local government areas of the town, fifteen (15) wards that were located in the indigenous zone constituted the study area. Respondents were selected along one out of every three (33.3%) of the Trunk — C (local) roads being the one mostly used for the purpose in the study area. The respondents were the residents, commercial motorists, commercial motorcyclists, and celebrants. Six hundred and forty-two (642) copies of questionnaire were administered and harvested on the spot. The Mean Analysis generated from the respondents’ rating of twelve perceived hazards listed in the questionnaire were then used to determine respondents’ most highly rated perceived consequences of the practice. These were noisy environment, Blockage of drainage by waste, and Endangering the life of the sick on the way to hospital; the most highly rated reasons why the practice came into being; and level of acceptability of the practice which was found to be very unacceptable in the study area. Policy makers should therefore focus their attention on strict enforcement of the law prohibiting the practice in order to ensure more cordial relationship among the citizenry, seeing citizens’ unacceptability of the practice in the study area.

scholarly journals A Deep Learning Approach to Predict Autism Spectrum Disorder Using Multisite Resting-State fMRI

2021 ◽  
Vol 11 (8) ◽  
pp. 3636
Author(s):  
Faria Zarin Subah ◽  
Kaushik Deb ◽  
Pranab Kumar Dhar ◽  
Takeshi Koshiba
Keyword(s):  
Autism Spectrum Disorder ◽  
Resting State ◽  
State Of The Art ◽  
Resting State Fmri ◽  
Autism Spectrum ◽  
Spectrum Disorder ◽  
Bootstrap Analysis ◽  
Proposed Model ◽  
Art Methods ◽  
The Mean

Autism spectrum disorder (ASD) is a complex and degenerative neuro-developmental disorder. Most of the existing methods utilize functional magnetic resonance imaging (fMRI) to detect ASD with a very limited dataset which provides high accuracy but results in poor generalization. To overcome this limitation and to enhance the performance of the automated autism diagnosis model, in this paper, we propose an ASD detection model using functional connectivity features of resting-state fMRI data. Our proposed model utilizes two commonly used brain atlases, Craddock 200 (CC200) and Automated Anatomical Labelling (AAL), and two rarely used atlases Bootstrap Analysis of Stable Clusters (BASC) and Power. A deep neural network (DNN) classifier is used to perform the classification task. Simulation results indicate that the proposed model outperforms state-of-the-art methods in terms of accuracy. The mean accuracy of the proposed model was 88%, whereas the mean accuracy of the state-of-the-art methods ranged from 67% to 85%. The sensitivity, F1-score, and area under receiver operating characteristic curve (AUC) score of the proposed model were 90%, 87%, and 96%, respectively. Comparative analysis on various scoring strategies show the superiority of BASC atlas over other aforementioned atlases in classifying ASD and control.

scholarly journals PCAN—Part-Based Context Attention Network for Thermal Power Plant Detection in Remote Sensing Imagery

2021 ◽  
Vol 13 (7) ◽  
pp. 1243
Author(s):  
Wenxin Yin ◽  
Wenhui Diao ◽  
Peijin Wang ◽  
Xin Gao ◽  
Ya Li ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Power Plants ◽  
State Of The Art ◽  
Thermal Power ◽  
Image Interpretation ◽  
Remote Sensing Image ◽  
Thermal Power Plants ◽  
Average Precision ◽  
Deep Convolutional Neural Networks ◽  
Multi Scale

The detection of Thermal Power Plants (TPPs) is a meaningful task for remote sensing image interpretation. It is a challenging task, because as facility objects TPPs are composed of various distinctive and irregular components. In this paper, we propose a novel end-to-end detection framework for TPPs based on deep convolutional neural networks. Specifically, based on the RetinaNet one-stage detector, a context attention multi-scale feature extraction network is proposed to fuse global spatial attention to strengthen the ability in representing irregular objects. In addition, we design a part-based attention module to adapt to TPPs containing distinctive components. Experiments show that the proposed method outperforms the state-of-the-art methods and can achieve 68.15% mean average precision.

scholarly journals Representation Learning for Fine-Grained Change Detection

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4486
Author(s):  
Niall O’Mahony ◽  
Sean Campbell ◽  
Lenka Krpalkova ◽  
Anderson Carvalho ◽  
Joseph Walsh ◽  
...  
Keyword(s):  
Deep Learning ◽  
Change Detection ◽  
Model Calibration ◽  
State Of The Art ◽  
Representation Learning ◽  
Machine Intelligence ◽  
The State ◽  
Sensor Data ◽  
Fine Grained ◽  
Learning Techniques

Fine-grained change detection in sensor data is very challenging for artificial intelligence though it is critically important in practice. It is the process of identifying differences in the state of an object or phenomenon where the differences are class-specific and are difficult to generalise. As a result, many recent technologies that leverage big data and deep learning struggle with this task. This review focuses on the state-of-the-art methods, applications, and challenges of representation learning for fine-grained change detection. Our research focuses on methods of harnessing the latent metric space of representation learning techniques as an interim output for hybrid human-machine intelligence. We review methods for transforming and projecting embedding space such that significant changes can be communicated more effectively and a more comprehensive interpretation of underlying relationships in sensor data is facilitated. We conduct this research in our work towards developing a method for aligning the axes of latent embedding space with meaningful real-world metrics so that the reasoning behind the detection of change in relation to past observations may be revealed and adjusted. This is an important topic in many fields concerned with producing more meaningful and explainable outputs from deep learning and also for providing means for knowledge injection and model calibration in order to maintain user confidence.

scholarly journals Efficient Rank-Based Diffusion Process with Assured Convergence

2021 ◽  
Vol 7 (3) ◽  
pp. 49
Author(s):  
Daniel Carlos Guimarães Pedronette ◽  
Lucas Pascotti Valem ◽  
Longin Jan Latecki
Keyword(s):  
Diffusion Process ◽  
Learning Strategies ◽  
State Of The Art ◽  
Representation Learning ◽  
Theoretical Background ◽  
High Dimensional ◽  
Visual Features ◽  
Learning Approaches ◽  
Previous Decade ◽  
Asymptotic Complexity

Visual features and representation learning strategies experienced huge advances in the previous decade, mainly supported by deep learning approaches. However, retrieval tasks are still performed mainly based on traditional pairwise dissimilarity measures, while the learned representations lie on high dimensional manifolds. With the aim of going beyond pairwise analysis, post-processing methods have been proposed to replace pairwise measures by globally defined measures, capable of analyzing collections in terms of the underlying data manifold. The most representative approaches are diffusion and ranked-based methods. While the diffusion approaches can be computationally expensive, the rank-based methods lack theoretical background. In this paper, we propose an efficient Rank-based Diffusion Process which combines both approaches and avoids the drawbacks of each one. The obtained method is capable of efficiently approximating a diffusion process by exploiting rank-based information, while assuring its convergence. The algorithm exhibits very low asymptotic complexity and can be computed regionally, being suitable to outside of dataset queries. An experimental evaluation conducted for image retrieval and person re-ID tasks on diverse datasets demonstrates the effectiveness of the proposed approach with results comparable to the state-of-the-art.

scholarly journals Efficient Graph Collaborative Filtering via Contrastive Learning

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4666
Author(s):  
Zhiqiang Pan ◽  
Honghui Chen
Keyword(s):  
Collaborative Filtering ◽  
State Of The Art ◽  
Representation Learning ◽  
First Order ◽  
Satisfactory Performance ◽  
Potential Applications ◽  
Benchmark Datasets ◽  
Bayesian Personalized Ranking ◽  
Graph Neural Networks ◽  
Training Efficiency

Collaborative filtering (CF) aims to make recommendations for users by detecting user’s preference from the historical user–item interactions. Existing graph neural networks (GNN) based methods achieve satisfactory performance by exploiting the high-order connectivity between users and items, however they suffer from the poor training efficiency problem and easily introduce bias for information propagation. Moreover, the widely applied Bayesian personalized ranking (BPR) loss is insufficient to provide supervision signals for training due to the extremely sparse observed interactions. To deal with the above issues, we propose the Efficient Graph Collaborative Filtering (EGCF) method. Specifically, EGCF adopts merely one-layer graph convolution to model the collaborative signal for users and items from the first-order neighbors in the user–item interactions. Moreover, we introduce contrastive learning to enhance the representation learning of users and items by deriving the self-supervisions, which is jointly trained with the supervised learning. Extensive experiments are conducted on two benchmark datasets, i.e., Yelp2018 and Amazon-book, and the experimental results demonstrate that EGCF can achieve the state-of-the-art performance in terms of Recall and normalized discounted cumulative gain (NDCG), especially on ranking the target items at right positions. In addition, EGCF shows obvious advantages in the training efficiency compared with the competitive baselines, making it practicable for potential applications.

scholarly journals Effectiveness of Home-Based Occupational Therapy on COPM Performance and Satisfaction Scores in Patients with COPD

2020 ◽  
pp. 000841742097112
Author(s):  
Eleonore H. Koolen ◽  
Martijn A. Spruit ◽  
Marianne de Man ◽  
Jeanine C. Antons ◽  
Elieke Nijhuis ◽  
...  
Keyword(s):  
Occupational Therapy ◽  
Integrated Management ◽  
Performance Measure ◽  
Occupational Performance ◽  
Post Intervention ◽  
Canadian Occupational Performance Measure ◽  
Home Based ◽  
Copd Patients ◽  
The Mean ◽  
Mean Differences

Background. Occupational therapy (OT) may be an important intervention in patients with COPD, but studies show conflicting results. Purpose. To evaluate the effectiveness of home-based monodisciplinary OT in COPD patients Method. We conducted an observational clinical study. Main outcomes were the mean differences in the Canadian Occupational Performance Measure (COPM) performance and satisfaction scores, pre and post intervention. Findings. Pre- and postintervention data were obtained from 41 patients. Statistically significant increases were observed in COPM performance (5.0 ± 1.1 versus 6.9 ± 0.9; P<0.001) and satisfaction (4.6 ± 1.3 versus 6.9 ± 1.0; P<0.001). The most frequently reported occupational performance problems were found in the domains of productivity (47%) and mobility (40%), fewer in self-care (10%) and the least in leisure (3%). Implications. Home-based monodisciplinary OT can contribute significantly to the improvement of daily functioning of patients with COPD. OT should therefore be considered more often as part of the integrated management of these patients.

Sign in / Sign up

Export Citation Format

Share Document