Efficiently generating correction suggestions for garbled tokens of historical language

2011 ◽  
Vol 17 (2) ◽  
pp. 265-282 ◽  
Author(s):  
ULRICH REFFLE
Keyword(s):  
Character Recognition ◽  
Optical Character Recognition ◽  
Language Use ◽  
Document Collections ◽  
Modern Language ◽  
Approximate Search ◽  
Spelling Variation ◽  
Matching Procedure ◽  
Text Correction ◽  
Current Systems

AbstractText correction systems rely on a core mechanism where suitable correction suggestions for garbled input tokens are generated. Current systems, which are designed for documents including modern language, use some form of approximate search in a given background lexicon. Due to the large amount of spelling variation found in historical documents, special lexica for historical language can only offer restricted coverage. Hence historical language is often described in terms of a matching procedure to be applied to modern words. Given such a procedure and a base lexicon of modern words, the question arises of how to generate correction suggestions for garbled historical variants. In this paper we suggest an efficient algorithm that solves this problem. The algorithm is used for postcorrection of optical character recognition results on historical document collections.

scholarly journals sOCRates - a post-OCR text correction method

2021 ◽  
Author(s):  
Danny Suarez Vargas ◽  
Lucas Lima de Oliveira ◽  
Viviane P. Moreira ◽  
Guilherme Torresan Bazzo ◽  
Gustavo Acauan Lorentz
Keyword(s):  
Information Retrieval ◽  
Character Recognition ◽  
Optical Character Recognition ◽  
Negative Impact ◽  
Correction Method ◽  
Test Collection ◽  
Mining System ◽  
Plain Text ◽  
Information Retrieval Systems ◽  
Text Correction

A significant portion of the textual information of interest to an organization is stored in PDF files that should be converted into plain text before their contents can be processed by an information retrieval or text mining system. When the PDF documents consist of scanned documents, optical character recognition (OCR) is typically used to extract the textual contents. OCR errors can have a negative impact on the quality of information retrieval systems since the terms in the query will not match incorrectly extracted terms in the documents. This work introduces sOCRates, a post-OCR text correction method that relies on contextual word embeddings and on a classifier that uses format, semantic, and syntactic features. Our experimental evaluation on a test collection in Portuguese showed that sOCRates can accurately correct errors and improve retrieval results.

A Structured Method for the Recognition of Complex Historical Tables

1997 ◽  
Vol 9 (1-3) ◽  
pp. 58-77
Author(s):  
Vitaly Kliatskine ◽  
Eugene Shchepin ◽  
Gunnar Thorvaldsen ◽  
Konstantin Zingerman ◽  
Valery Lazarev
Keyword(s):  
Nineteenth Century ◽  
Character Recognition ◽  
Optical Character Recognition ◽  
Complex Structure ◽  
Source Material ◽  
Historical Sources ◽  
Tax Assessment ◽  
Optical Character ◽  
Algorithmic Model ◽  
Machine Readable

In principle, printed source material should be made machine-readable with systems for Optical Character Recognition, rather than being typed once more. Offthe-shelf commercial OCR programs tend, however, to be inadequate for lists with a complex layout. The tax assessment lists that assess most nineteenth century farms in Norway, constitute one example among a series of valuable sources which can only be interpreted successfully with specially designed OCR software. This paper considers the problems involved in the recognition of material with a complex table structure, outlining a new algorithmic model based on ‘linked hierarchies’. Within the scope of this model, a variety of tables and layouts can be described and recognized. The ‘linked hierarchies’ model has been implemented in the ‘CRIPT’ OCR software system, which successfully reads tables with a complex structure from several different historical sources.

CNN-based Rain Reduction in Street View Images

2020 ◽  
Vol 2020 (1) ◽  
pp. 78-81
Author(s):  
Simone Zini ◽  
Simone Bianco ◽  
Raimondo Schettini
Keyword(s):  
Character Recognition ◽  
Optical Character Recognition ◽  
State Of The Art ◽  
Weather Conditions ◽  
Specific Interest ◽  
Optical Character ◽  
Street View ◽  
In The Wild ◽  
Bad Weather ◽  
Detection And Recognition

Rain removal from pictures taken under bad weather conditions is a challenging task that aims to improve the overall quality and visibility of a scene. The enhanced images usually constitute the input for subsequent Computer Vision tasks such as detection and classification. In this paper, we present a Convolutional Neural Network, based on the Pix2Pix model, for rain streaks removal from images, with specific interest in evaluating the results of the processing operation with respect to the Optical Character Recognition (OCR) task. In particular, we present a way to generate a rainy version of the Street View Text Dataset (R-SVTD) for "text detection and recognition" evaluation in bad weather conditions. Experimental results on this dataset show that our model is able to outperform the state of the art in terms of two commonly used image quality metrics, and that it is capable to improve the performances of an OCR model to detect and recognise text in the wild.

Pengantar dan Survey Tentang Optical Music Recognition

2014 ◽  
Vol 6 (1) ◽  
pp. 36-39
Author(s):  
Kevin Purwito
Keyword(s):  
Character Recognition ◽  
Optical Character Recognition ◽  
Optical Music Recognition ◽  
Optical Character ◽  
Digital Format ◽  
Music Recognition ◽  
Index Terms ◽  
The Many ◽  
Further Development ◽  
Music Symbol

This paper describes about one of the many extension of Optical Character Recognition (OCR), that is Optical Music Recognition (OMR). OMR is used to recognize musical sheets into digital format, such as MIDI or MusicXML. There are many musical symbols that usually used in musical sheets and therefore needs to be recognized by OMR, such as staff; treble, bass, alto and tenor clef; sharp, flat and natural; beams, staccato, staccatissimo, dynamic, tenuto, marcato, stopped note, harmonic and fermata; notes; rests; ties and slurs; and also mordent and turn. OMR usually has four main processes, namely Preprocessing, Music Symbol Recognition, Musical Notation Reconstruction and Final Representation Construction. Each of those four main processes uses different methods and algorithms and each of those processes still needs further development and research. There are already many application that uses OMR to date, but none gives the perfect result. Therefore, besides the development and research for each OMR process, there is also a need to a development and research for combined recognizer, that combines the results from different OMR application to increase the final result’s accuracy. Index Terms—Music, optical character recognition, optical music recognition, musical symbol, image processing, combined recognizer  

Sign in / Sign up

Export Citation Format

Share Document