Use Jupyter to Restart the Script from the Point Where the Scrapper Terminated

Written by databug | Published 2020/03/02
Tech Story Tags: jupyter-notebook | python | web-scraping | selenium | tips | jupyter-scraping-time-machine | programming | software-development | web-monetization

TLDR Using Jupyter, you can restart the script from the point where the scrapper has terminated. The solution depends on the “running code” feature, where we could run blocks of code independently from each batch. Python, Selenium, Pandas, Beautiful Soup, and your good old friend time are the library you need for this project. But do beware of the continuous error if the website server is unstable like my target website. The rest of the code is running :-)via the TL;DR App

no story

Written by databug | Data Scientist who loves anything Data. From South Korea
Published by HackerNoon on 2020/03/02