Title:OCR of historical printings with an application to building diachronic corpora: A case study using the RIDGES herbal corpus

Abstract:This article describes the results of a case study to apply Optical Character Recognition (OCR) to scanned images of books printed between 1487 and 1870 by training the OCR engine OCRopus (Breuel et al. 2013) on the RIDGES herbal text corpus (Odebrecht et al., submitted). The resulting machine-readable text has character accuracies (percentage of correctly recognized characters) from 94% to more than 99% for even the earliest printed books, which were thought to be inaccessible by OCR methods until recently. Training specific OCR models was possible because the necessary "ground truth" has been available as error-corrected diplomatic transcriptions. The OCR results have been evaluated for accuracy against the ground truth of unseen test sets. Furthermore, mixed OCR models trained on a subset of books have been tested for their predictive power on page images of other books in the corpus, mostly yielding character accuracies well above 90%. It therefore seems possible to construct generalized models covering a range of fonts that can be applied to a wide variety of historical printings. A moderate postcorrection effort of some pages will then enable the training of individual models with even better accuracies. Using this method, diachronic corpora including early printings can be constructed much faster and cheaper than by manual transcription. The OCR methods reported here open up the possibility of transforming our printed textual cultural heritage into electronic text by largely automatic means, which is a prerequisite for the mass conversion of scanned books.