🤷🏻‍ The Problem I bought a printed book about Machine Learning recently and while I was reading through the first several chapters I've encountered many printed links in the text that looked like or . https://tensorflow.org/ https://some-url.com/which/may/be/even/longer?and_with_params=true I saw all these links, but I couldn't click on them since they were printed (thanks, cap!). To visit these links I needed to start typing them character by character in the browser's address bar, which was pretty annoying and error-prone. 💡 The Solution So, I was thinking, what if, similarly to QR-code detection, we will try to "teach" the smartphone to and printed links for us and to make them ? This way you would do just one click instead of multiple keystrokes. The operational complexity of "clicking" the printed links goes from to . (1) detect (2) recognize clickable O(N) O(1) This is exactly what I've tried to achieve by making a app. It makes you do just one click on the link instead of typing the whole link manually character by character. Links Detector I came up with a custom dataset of photos of book pages that contained links in it. I used to train a custom object detector model to find positions and bounding boxes of the sub-strings like in the text image (i.e. in smartphone camera stream). You may found the details of the training in long read article. 120 TensorFlow 2 Object Detection API https:// 📖 👆🏻 Making the Printed Links Clickable Using TensorFlow 2 Object Detection API The text of each link (right continuation of bounding box) was recognized by using library. https:// Tesseract 🚀 from your smartphone to see the final result. Launch Links Detector demo 📝 on GitHub to see the complete source code of the application. Open links-detector repository ⚠️ Limitations Currently, the application is in stage and has . So don't raise your expectations level too high until these issues are resolved 🤷🏻‍. experimental Alpha many issues and limitations ⚙️ Technologies is a pure frontend application written on . Links detection is happening right in your browser without the need of sending images to the server. Links Detector React TypeScript is (Progressive Web App) friendly application made on top of a library. While you navigate through the app it tries to cache all resources to make them available offline and to make consequent visits much faster for you. You may also Links Detector as a standalone app on your smartphone. Links Detector PWA Workbox install Links detection and recognition happens by means of and libraries which in turn rely on and browser support. TensorFlow Tesseract.js WebGL WebAssembly Also published at https://towardsdatascience.com/making-the-printed-links-clickable-using-tensorflow-2-object-detection-api-be42bd65488a

Progressive

2022 - HackerNoon Contributor of the Year - Algorithms

2022 - HackerNoon Contributor of the Year - Computer Science

2022 - HackerNoon Contributor of the Year - Github

Nominated for 2022 - HackerNoon Contributor of the Year - Algorithms

Nominated for 2022 - HackerNoon Contributor of the Year - Computer Science

Nominated for 2022 - HackerNoon Contributor of the Year - Github

Too Long; Didn't Read

In your car, at home, or at work — Bosch technology shapes many areas of life.

How To Build Links Detector That Making Links in Your Book Clickable

Too Long; Didn't Read

Company Mentioned

Oleksii Trekhleb

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

How To Build Links Detector That Making Links in Your Book Clickable

Too Long; Didn't Read

Company Mentioned

Oleksii Trekhleb

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

RELATED STORIES