Use Jupyter to Restart the Script from the Point Where the Scrapper Terminated

Written by databug | Published 2020/03/02
Tech Story Tags: jupyter-notebook | python | web-scraping | selenium | tips | jupyter-scraping-time-machine | programming | software-development | web-monetization

TLDR Using Jupyter, you can restart the script from the point where the scrapper has terminated. The solution depends on the “running code” feature, where we could run blocks of code independently from each batch. Python, Selenium, Pandas, Beautiful Soup, and your good old friend time are the library you need for this project. But do beware of the continuous error if the website server is unstable like my target website. The rest of the code is running :-)via the TL;DR App
no story
Written by databug | Data Scientist who loves anything Data. From South Korea
Published by HackerNoon on 2020/03/02
ABOUTHow hackers start their afternoons. We publish tech stories and build publishing software.

READEntirely free library read by hundreds of millions to learn anything about any technology.

WRITEHackerNoon elevates quality technology writing far and wide across the interwebs.

PARTNERHackerNoon works directly with tech companies to place ads by content relevancy