scholarly journals Unsupervised Trademark Retrieval Method Based on Attention Mechanism

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1894
Author(s):  
Jiangzhong Cao ◽  
Yunfei Huang ◽  
Qingyun Dai ◽  
Wing-Kuen Ling
Keyword(s):  
Supervised Learning ◽  
Attention Mechanism ◽  
Feature Representation ◽  
Experimental Results ◽  
Learning Methods ◽  
Retrieval Method ◽  
Average Rank ◽  
Good Feature ◽  
Key Features ◽  
Better Than

Aiming at the high cost of data labeling and ignoring the internal relevance of features in existing trademark retrieval methods, this paper proposes an unsupervised trademark retrieval method based on attention mechanism. In the proposed method, the instance discrimination framework is adopted and a lightweight attention mechanism is introduced to allocate a more reasonable learning weight to key features. With an unsupervised way, this proposed method can obtain good feature representation of trademarks and improve the performance of trademark retrieval. Extensive comparative experiments on the METU trademark dataset are conducted. The experimental results show that the proposed method is significantly better than traditional trademark retrieval methods and most existing supervised learning methods. The proposed method obtained a smaller value of NAR (Normalized Average Rank) at 0.051, which verifies the effectiveness of the proposed method in trademark retrieval.

scholarly journals Non-I.I.D. Multi-Instance Learning for Predicting Instance and Bag Labels with Variational Auto-Encoder

2021 ◽  
Author(s):  
Weijia Zhang
Keyword(s):  
Medical Imaging ◽  
Supervised Learning ◽  
Real World ◽  
State Of The Art ◽  
Experimental Results ◽  
Weakly Supervised Learning ◽  
Variational Autoencoder ◽  
Label Prediction ◽  
Weakly Supervised ◽  
Better Than

Multi-instance learning is a type of weakly supervised learning. It deals with tasks where the data is a set of bags and each bag is a set of instances. Only the bag labels are observed whereas the labels for the instances are unknown. An important advantage of multi-instance learning is that by representing objects as a bag of instances, it is able to preserve the inherent dependencies among parts of the objects. Unfortunately, most existing algorithms assume all instances to be identically and independently distributed, which violates real-world scenarios since the instances within a bag are rarely independent. In this work, we propose the Multi-Instance Variational Autoencoder (MIVAE) algorithm which explicitly models the dependencies among the instances for predicting both bag labels and instance labels. Experimental results on several multi-instance benchmarks and end-to-end medical imaging datasets demonstrate that MIVAE performs better than state-of-the-art algorithms for both instance label and bag label prediction tasks.

scholarly journals Biomedical document triage using a hierarchical attention-based capsule network

2020 ◽  
Vol 21 (S13) ◽  
Author(s):  
Jian Wang ◽  
Mengying Li ◽  
Qishuai Diao ◽  
Hongfei Lin ◽  
Zhihao Yang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Information Extraction ◽  
Precision Medicine ◽  
State Of The Art ◽  
Attention Mechanism ◽  
Feature Representation ◽  
Experimental Results ◽  
Biomedical Domain ◽  
Proposed Model ◽  
Document Triage

Abstract Background Biomedical document triage is the foundation of biomedical information extraction, which is important to precision medicine. Recently, some neural networks-based methods have been proposed to classify biomedical documents automatically. In the biomedical domain, documents are often very long and often contain very complicated sentences. However, the current methods still find it difficult to capture important features across sentences. Results In this paper, we propose a hierarchical attention-based capsule model for biomedical document triage. The proposed model effectively employs hierarchical attention mechanism and capsule networks to capture valuable features across sentences and construct a final latent feature representation for a document. We evaluated our model on three public corpora. Conclusions Experimental results showed that both hierarchical attention mechanism and capsule networks are helpful in biomedical document triage task. Our method proved itself highly competitive or superior compared with other state-of-the-art methods.

scholarly journals Adversarial Cross-Domain Action Recognition with Co-Attention

2020 ◽  
Vol 34 (07) ◽  
pp. 11815-11822 ◽  
Author(s):  
Boxiao Pan ◽  
Zhangjie Cao ◽  
Ehsan Adeli ◽  
Juan Carlos Niebles
Keyword(s):  
Supervised Learning ◽  
Action Recognition ◽  
Image Recognition ◽  
Attention Mechanism ◽  
Experimental Results ◽  
Single Domain ◽  
Attention Network ◽  
Cross Domain ◽  
The Cross ◽  
Temporal Misalignment

Action recognition has been a widely studied topic with a heavy focus on supervised learning involving sufficient labeled videos. However, the problem of cross-domain action recognition, where training and testing videos are drawn from different underlying distributions, remains largely under-explored. Previous methods directly employ techniques for cross-domain image recognition, which tend to suffer from the severe temporal misalignment problem. This paper proposes a Temporal Co-attention Network (TCoN), which matches the distributions of temporally aligned action features between source and target domains using a novel cross-domain co-attention mechanism. Experimental results on three cross-domain action recognition datasets demonstrate that TCoN improves both previous single-domain and cross-domain methods significantly under the cross-domain setting.

scholarly journals Road Object Detection of YOLO Algorithm with Attention Mechanism

2021 ◽  
Vol 5 (1) ◽  
Author(s):  
Jiacheng Li ◽  
◽  
Huazhang Wang ◽  
Yuan Xu ◽  
Fan Liu ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Object Detection ◽  
Spatial Attention ◽  
High Precision ◽  
Detection Algorithm ◽  
Attention Mechanism ◽  
Experimental Results ◽  
Automatic Driving ◽  
Key Features ◽  
Detection Effect

In auto-driving cars, incorrect object detection can lead to serious accidents, so high-precision object detection is the key to automatic driving. This paper improves on the YOLOv3 object detection algorithm, and introduces the channel attention mechanism and spatial attention mechanism into the feature extraction network, which is used to autonomously learn the weight of each channel, enhance key features, and suppress redundant features. Experimental results show that the detection effect of the improved network algorithm is significantly higher than that of the YOLOv3 algorithm.

scholarly journals A Novel Feature-based Bayesian Model for Query Focused Multi-document Summarization

2013 ◽  
Vol 1 ◽  
pp. 89-98 ◽  
Author(s):  
Jiwei Li ◽  
Sujian Li
Keyword(s):  
Supervised Learning ◽  
Bayesian Model ◽  
Topic Model ◽  
Topic Models ◽  
Experimental Results ◽  
Learning Methods ◽  
Document Summarization ◽  
Feature Based

Supervised learning methods and LDA based topic model have been successfully applied in the field of multi-document summarization. In this paper, we propose a novel supervised approach that can incorporate rich sentence features into Bayesian topic models in a principled way, thus taking advantages of both topic model and feature based supervised learning methods. Experimental results on DUC2007, TAC2008 and TAC2009 demonstrate the effectiveness of our approach.

scholarly journals Research on Face Recognition Classification Based on Improved GoogleNet

2022 ◽  
Vol 2022 ◽  
pp. 1-6
Author(s):  
Zhigang Yu ◽  
Yunyun Dong ◽  
Jihong Cheng ◽  
Miaomiao Sun ◽  
Feng Su
Keyword(s):  
Face Recognition ◽  
Network Performance ◽  
Recall Rate ◽  
Experimental Results ◽  
Learning Technology ◽  
Learning Method ◽  
Learning Methods ◽  
Improve Accuracy ◽  
And Migration ◽  
Better Than

Face recognition is a relatively mature technology, which has some applications in many aspects, and now there are many networks studying it, which has indeed brought a lot of convenience to mankind in all aspects. This paper proposes a new face recognition technology. First, a new GoogLeNet-M network is proposed, which improves network performance on the basis of streamlining the network. Secondly, regularization and migration learning methods are added to improve accuracy. The experimental results show that the GoogLeNet-M network with regularization using migration learning technology has the best performance, with a recall rate of 0.97 and an accuracy of 0.98. Finally, it is concluded that the performance of the GoogLeNet-M network is better than other networks on the dataset, and the migration learning method and regularization help to improve the network performance.

THE SOURCES OF AUXIN HORMONE TO GROWTH OF SHOOT PINEAPPLE STEM CUTTING (Ananascomosus.L. Merr.)

2016 ◽  
Vol 1 (1) ◽  
pp. 45-52
Author(s):  
Palupi Puspitorini
Keyword(s):  
Water Concentration ◽  
Urine Concentration ◽  
Experimental Results ◽  
Stem Cuttings ◽  
Randomized Design ◽  
Natural Hormone ◽  
Cow Urine ◽  
Urine Concentrations ◽  
Completely Randomized Design ◽  
Better Than

The aim of this study was to select the best sources of auxin of which it can stimulate the growth of shoots Pineapple plant cuttings. This research is compiled in a completely randomized design (CRD) with 4 treatments and 6 replications. The Data were statistically Analyzed by the DMRT. Level of treatment given proves that no treatment 0%, cow urine concentration of 25%, young coconut water concentration of 25% and Rootone F 100 mg / cuttings. The results showed that cow urine concentrations of 25% and Rootone F 100 mg give the best results in stimulating the growth of shoots pineapple stem cuttings. Experimental results concluded that the effect of this natural hormone were better than the shoots without given hormone.           

A Computational Method for the Identification of Endolysins and Autolysins

2020 ◽  
Vol 27 (4) ◽  
pp. 329-336 ◽  
Author(s):  
Lei Xu ◽  
Guangmin Liang ◽  
Baowen Chen ◽  
Xu Tan ◽  
Huaikun Xiang ◽  
...  
Keyword(s):  
Support Vector Machine ◽  
Cell Wall ◽  
Experimental Results ◽  
Computational Method ◽  
Lytic Enzyme ◽  
Support Vector ◽  
Lytic Enzymes ◽  
Data Set ◽  
Optimal Feature ◽  
Better Than

Background: Cell lytic enzyme is a kind of highly evolved protein, which can destroy the cell structure and kill the bacteria. Compared with antibiotics, cell lytic enzyme will not cause serious problem of drug resistance of pathogenic bacteria. Thus, the study of cell wall lytic enzymes aims at finding an efficient way for curing bacteria infectious. Compared with using antibiotics, the problem of drug resistance becomes more serious. Therefore, it is a good choice for curing bacterial infections by using cell lytic enzymes. Cell lytic enzyme includes endolysin and autolysin and the difference between them is the purpose of the break of cell wall. The identification of the type of cell lytic enzymes is meaningful for the study of cell wall enzymes. Objective: In this article, our motivation is to predict the type of cell lytic enzyme. Cell lytic enzyme is helpful for killing bacteria, so it is meaningful for study the type of cell lytic enzyme. However, it is time consuming to detect the type of cell lytic enzyme by experimental methods. Thus, an efficient computational method for the type of cell lytic enzyme prediction is proposed in our work. Method: We propose a computational method for the prediction of endolysin and autolysin. First, a data set containing 27 endolysins and 41 autolysins is built. Then the protein is represented by tripeptides composition. The features are selected with larger confidence degree. At last, the classifier is trained by the labeled vectors based on support vector machine. The learned classifier is used to predict the type of cell lytic enzyme. Results: Following the proposed method, the experimental results show that the overall accuracy can attain 97.06%, when 44 features are selected. Compared with Ding's method, our method improves the overall accuracy by nearly 4.5% ((97.06-92.9)/92.9%). The performance of our proposed method is stable, when the selected feature number is from 40 to 70. The overall accuracy of tripeptides optimal feature set is 94.12%, and the overall accuracy of Chou's amphiphilic PseAAC method is 76.2%. The experimental results also demonstrate that the overall accuracy is improved by nearly 18% when using the tripeptides optimal feature set. Conclusion: The paper proposed an efficient method for identifying endolysin and autolysin. In this paper, support vector machine is used to predict the type of cell lytic enzyme. The experimental results show that the overall accuracy of the proposed method is 94.12%, which is better than some existing methods. In conclusion, the selected 44 features can improve the overall accuracy for identification of the type of cell lytic enzyme. Support vector machine performs better than other classifiers when using the selected feature set on the benchmark data set.

scholarly journals A Global-Local Blur Disentangling Network for Dynamic Scene Deblurring

2021 ◽  
Vol 11 (5) ◽  
pp. 2174
Author(s):  
Xiaoguang Li ◽  
Feifan Yang ◽  
Jianglu Huang ◽  
Li Zhuo
Keyword(s):  
Local Features ◽  
Attention Mechanism ◽  
Experimental Results ◽  
Dynamic Scene ◽  
Feature Maps ◽  
Training Scheme ◽  
Real Scene ◽  
Global And Local

Images captured in a real scene usually suffer from complex non-uniform degradation, which includes both global and local blurs. It is difficult to handle the complex blur variances by a unified processing model. We propose a global-local blur disentangling network, which can effectively extract global and local blur features via two branches. A phased training scheme is designed to disentangle the global and local blur features, that is the branches are trained with task-specific datasets, respectively. A branch attention mechanism is introduced to dynamically fuse global and local features. Complex blurry images are used to train the attention module and the reconstruction module. The visualized feature maps of different branches indicated that our dual-branch network can decouple the global and local blur features efficiently. Experimental results show that the proposed dual-branch blur disentangling network can improve both the subjective and objective deblurring effects for real captured images.

Sign in / Sign up

Export Citation Format

Share Document