scholarly journals A pooling based scene text proposal technique for scene text reading in the wild

2019 ◽  
Vol 87 ◽  
pp. 118-129 ◽  
Author(s):  
Dinh NguyenVan ◽  
Shijian Lu ◽  
Shangxuan Tian ◽  
Nizar Ouarti ◽  
Mounir Mokhtari
Keyword(s):  
Scene Text ◽  
In The Wild ◽  
Text Reading

scholarly journals A Robot Object Recognition Method Based on Scene Text Reading in Home Environments

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1919
Author(s):  
Shuhua Liu ◽  
Huixin Xu ◽  
Qi Li ◽  
Fei Zhang ◽  
Kun Hou
Keyword(s):  
Object Recognition ◽  
Recognition Accuracy ◽  
Multiple Objects ◽  
Recognition Method ◽  
Home Environments ◽  
Complex Scenes ◽  
Scene Text ◽  
Text Reading ◽  
Text Images ◽  
Chinese And English

With the aim to solve issues of robot object recognition in complex scenes, this paper proposes an object recognition method based on scene text reading. The proposed method simulates human-like behavior and accurately identifies objects with texts through careful reading. First, deep learning models with high accuracy are adopted to detect and recognize text in multi-view. Second, datasets including 102,000 Chinese and English scene text images and their inverse are generated. The F-measure of text detection is improved by 0.4% and the recognition accuracy is improved by 1.26% because the model is trained by these two datasets. Finally, a robot object recognition method is proposed based on the scene text reading. The robot detects and recognizes texts in the image and then stores the recognition results in a text file. When the user gives the robot a fetching instruction, the robot searches for corresponding keywords from the text files and achieves the confidence of multiple objects in the scene image. Then, the object with the maximum confidence is selected as the target. The results show that the robot can accurately distinguish objects with arbitrary shape and category, and it can effectively solve the problem of object recognition in home environments.

scholarly journals EnsNet: Ensconce Text in the Wild

2019 ◽  
Vol 33 ◽  
pp. 801-808 ◽  
Author(s):  
Shuaitao Zhang ◽  
Yuliang Liu ◽  
Lianwen Jin ◽  
Yaoxiong Huang ◽  
Songxuan Lai
Keyword(s):  
Generative Adversarial Network ◽  
Local Consistency ◽  
Adversarial Network ◽  
Image Patches ◽  
Scene Text ◽  
In The Wild ◽  
Lateral Connection ◽  
Previous State ◽  
End To End ◽  
General Object

A new method is proposed for removing text from natural images. The challenge is to first accurately localize text on the stroke-level and then replace it with a visually plausible background. Unlike previous methods that require image patches to erase scene text, our method, namely ensconce network (EnsNet), can operate end-to-end on a single image without any prior knowledge. The overall structure is an end-to-end trainable FCN-ResNet-18 network with a conditional generative adversarial network (cGAN). The feature of the former is first enhanced by a novel lateral connection structure and then refined by four carefully designed losses: multiscale regression loss and content loss, which capture the global discrepancy of different level features; texture loss and total variation loss, which primarily target filling the text region and preserving the reality of the background. The latter is a novel local-sensitive GAN, which attentively assesses the local consistency of the text erased regions. Both qualitative and quantitative sensitivity experiments on synthetic images and the ICDAR 2013 dataset demonstrate that each component of the EnsNet is essential to achieve a good performance. Moreover, our EnsNet can significantly outperform previous state-of-the-art methods in terms of all metrics. In addition, a qualitative experiment conducted on the SBMNet dataset further demonstrates that the proposed method can also preform well on general object (such as pedestrians) removal tasks. EnsNet is extremely fast, which can preform at 333 fps on an i5-8600 CPU device.

Toward Integrated Scene Text Reading

2014 ◽  
Vol 36 (2) ◽  
pp. 375-387 ◽  
Author(s):  
Jerod J. Weinman ◽  
Zachary Butler ◽  
Dugan Knoll ◽  
Jacqueline Feild
Keyword(s):  
Scene Text ◽  
Text Reading

Scene text reading based cloud compliance access

2020 ◽  
Vol 23 (4) ◽  
pp. 2633-2647
Author(s):  
Hezhong Pan ◽  
Chuanyi Liu ◽  
Shaoming Duan ◽  
Peiyi Han ◽  
Binxing Fang
Keyword(s):  
Scene Text ◽  
Text Reading ◽  
Cloud Compliance

A Cost-Efficient Framework for Scene Text Detection in the Wild

2021 ◽  
pp. 139-153
Author(s):  
Gangyan Zeng ◽  
Yuan Zhang ◽  
Yu Zhou ◽  
Xiaomeng Yang
Keyword(s):  
Text Detection ◽  
Scene Text Detection ◽  
Scene Text ◽  
In The Wild ◽  
Cost Efficient

Text Recognition in the Wild

2021 ◽  
Vol 54 (2) ◽  
pp. 1-35
Author(s):  
Xiaoxue Chen ◽  
Lianwen Jin ◽  
Yuanzhi Zhu ◽  
Canjie Luo ◽  
Tianwei Wang
Keyword(s):  
Text Recognition ◽  
Future Research ◽  
Natural Scenes ◽  
Wide Range ◽  
Scene Text ◽  
In The Wild ◽  
History Of ◽  
Active Research ◽  
Future Work ◽  
Scene Text Recognition

The history of text can be traced back over thousands of years. Rich and precise semantic information carried by text is important in a wide range of vision-based application scenarios. Therefore, text recognition in natural scenes has been an active research topic in computer vision and pattern recognition. In recent years, with the rise and development of deep learning, numerous methods have shown promising results in terms of innovation, practicality, and efficiency. This article aims to (1) summarize the fundamental problems and the state-of-the-art associated with scene text recognition, (2) introduce new insights and ideas, (3) provide a comprehensive review of publicly available resources, and (4) point out directions for future work. In summary, this literature review attempts to present an entire picture of the field of scene text recognition. It provides a comprehensive reference for people entering this field and could be helpful in inspiring future research. Related resources are available at our GitHub repository: https://github.com/HCIILAB/Scene-Text-Recognition.

scholarly journals Omnidirectional Scene Text Detection with Sequential-free Box Discretization

2019 ◽  
Author(s):  
Yuliang Liu ◽  
Sheng Zhang ◽  
Lianwen Jin ◽  
Lele Xie ◽  
Yaqiang Wu ◽  
...  
Keyword(s):  
State Of The Art ◽  
Detection Performance ◽  
Text Detection ◽  
Detection Methods ◽  
Bounding Box ◽  
Scene Text Detection ◽  
Scene Text ◽  
Art Methods ◽  
In The Wild ◽  
Ablation Study

Scene text in the wild is commonly presented with high variant characteristics. Using quadrilateral bounding box to localize the text instance is nearly indispensable for detection methods. However, recent researches reveal that introducing quadrilateral bounding box for scene text detection will bring a label confusion issue which is easily overlooked, and this issue may significantly undermine the detection performance. To address this issue, in this paper, we propose a novel method called Sequential-free Box Discretization (SBD) by discretizing the bounding box into key edges (KE) which can further derive more effective methods to improve detection performance. Experiments showed that the proposed method can outperform state-of-the-art methods in many popular scene text benchmarks, including ICDAR 2015, MLT, and MSRA-TD500. Ablation study also showed that simply integrating the SBD into Mask R-CNN framework, the detection performance can be substantially improved. Furthermore, an experiment on the general object dataset HRSC2016 (multi-oriented ships) showed that our method can outperform recent state-of-the-art methods by a large margin, demonstrating its powerful generalization ability.

Sign in / Sign up

Export Citation Format

Share Document