Table of Links Abstract and 1. Introduction Abstract and 1. Introduction 1.1 Printing Press in Iraq and Iraqi Kurdistan 1.1 Printing Press in Iraq and Iraqi Kurdistan 1.2 Challenges in Historical Documents 1.2 Challenges in Historical Documents 1.3 Kurdish Language 1.3 Kurdish Language Related work and 2.1 Arabic/Persian
2.2 Chinese/Japanese and 2.3 Coptic
2.4 Greek
2.5 Latin
2.6 Tamizhi


Method and 3.1 Data Collection
3.2 Data Preparation and 3.3 Preprocessing
3.4 Environment Setup, 3.5 Dataset Preparation, and 3.6 Evaluation


Experiments, Results, and Discussion and 4.1 Processed Data
4.2 Dataset and 4.3 Experiments
4.4 Results and Evaluation
4.5 Discussion


Conclusion
5.1 Challenges and Limitations
Online Resources, Acknowledgments, and References Related work and 2.1 Arabic/Persian
2.2 Chinese/Japanese and 2.3 Coptic
2.4 Greek
2.5 Latin
2.6 Tamizhi Related work and 2.1 Arabic/Persian Related work and 2.1 Arabic/Persian 2.2 Chinese/Japanese and 2.3 Coptic 2.2 Chinese/Japanese and 2.3 Coptic 2.4 Greek 2.4 Greek 2.5 Latin 2.5 Latin 2.6 Tamizhi 2.6 Tamizhi Method and 3.1 Data Collection
3.2 Data Preparation and 3.3 Preprocessing
3.4 Environment Setup, 3.5 Dataset Preparation, and 3.6 Evaluation Method and 3.1 Data Collection Method and 3.1 Data Collection 3.2 Data Preparation and 3.3 Preprocessing 3.2 Data Preparation and 3.3 Preprocessing 3.4 Environment Setup, 3.5 Dataset Preparation, and 3.6 Evaluation 3.4 Environment Setup, 3.5 Dataset Preparation, and 3.6 Evaluation Experiments, Results, and Discussion and 4.1 Processed Data
4.2 Dataset and 4.3 Experiments
4.4 Results and Evaluation
4.5 Discussion Experiments, Results, and Discussion and 4.1 Processed Data Experiments, Results, and Discussion and 4.1 Processed Data 4.2 Dataset and 4.3 Experiments 4.2 Dataset and 4.3 Experiments 4.4 Results and Evaluation 4.4 Results and Evaluation 4.5 Discussion 4.5 Discussion Conclusion
5.1 Challenges and Limitations
Online Resources, Acknowledgments, and References Conclusion Conclusion 5.1 Challenges and Limitations 5.1 Challenges and Limitations Online Resources, Acknowledgments, and References Online Resources, Acknowledgments, and References 4.4 Results and Evaluation After completing the training, we evaluated the model using different methods. In this section, we show the results for each evaluation method. During the training process, the trainer produces a report that outlines the model’s accuracy every 100 iterations. Once the training was completed, we assessed the model using Tesseract evaluation and obtained a minimal training error rate (BCER) value of 0.755%. We randomly chose a subset of pages from the collected data which were not utilized in the model’s training and testing. These pages were manually transcribed, and the page images and their corresponding manual transcriptions were submitted to Ocreval for evaluation. The outcomes of this evaluation can be observed in Figures 18, 19, 20, and 21. 4.5 Discussion The limited availability of resources presented significant challenges during our data collection process. Converting the collected data into a digital format proved to be an additional obstacle, for which we received support from the Zheen Center for Documentation and Re- search. Manual transcription of the documents posed considerable difficulty due to unclear text, non-standard spacing between words and characters, and unique vocabulary influenced by Arabic letters and terminologies. Also, we discovered that the system has challenges in properly extracting text from multi-column pages and mathematical equations. We retrained an existing Arabic model using our unique Kurdish dataset in this research, which yielded remarkable outcomes. Considering our findings, if we further train the model on a larger dataset, it has the potential to produce results suitable for production use. Such a model can significantly aid libraries and centers in effectively extracting text from historical documents. Authors:
(1) Blnd Yaseen, University of Kurdistan Howler, Kurdistan Region - Iraq (blnd.yaseen@ukh.edu.krd);
(2) Hossein Hassani University of Kurdistan Howler Kurdistan Region - Iraq (hosseinh@ukh.edu.krd). Authors: Authors: (1) Blnd Yaseen, University of Kurdistan Howler, Kurdistan Region - Iraq (blnd.yaseen@ukh.edu.krd); (2) Hossein Hassani University of Kurdistan Howler Kurdistan Region - Iraq (hosseinh@ukh.edu.krd). This paper is available on arxiv under ATTRIBUTION-NONCOMMERCIAL-NODERIVS 4.0 INTERNATIONAL license. This paper is available on arxiv under ATTRIBUTION-NONCOMMERCIAL-NODERIVS 4.0 INTERNATIONAL license. available on arxiv available on arxiv

Part of HackerNoon's growing list of open-source research papers, promoting free access to academic material.

Why OCR Struggles With Multi-Column Pages

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

73 Top Saudi Sites Were Analyzed for Font Morphology, Image Design and User Preferences

Can AI Save Centuries of Kurdish History?

Did You Know the First Kurdish Press Was Carried by Mule?

Why Historical Documents Are Hard to Digitize

Can AI Finally Crack Ottoman Text Recognition?

Advances in OCR for Historical Chinese, Japanese, Coptic, and Greek Texts

73 Top Saudi Sites Were Analyzed for Font Morphology, Image Design and User Preferences

Can AI Save Centuries of Kurdish History?

Did You Know the First Kurdish Press Was Carried by Mule?

Why Historical Documents Are Hard to Digitize

Can AI Finally Crack Ottoman Text Recognition?

Advances in OCR for Historical Chinese, Japanese, Coptic, and Greek Texts

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps