Scrape any web page with a single mouse click …

Written by mikeptweet | Published 2017/01/26
Tech Story Tags: web-development | javascript | web-scraping | scraping | data-scraping

TLDRvia the TL;DR App

and optionally export it to the clipboard or Excel, JSON, HTML, Tab or Comma delimited file formats!

In an earlier article, I demonstrated how to scrape any web site with a single SQL select statement.

Scrape any Website/Service/API with a single SQL Select Statement_I love SQL and it never ceases to amaze me what can be accomplished via the power of SQL syntax. In this example, we…_hackernoon.com

This turned out to be a popular article so I decided I’d take a different approach that accomplishes a similar task all from within the browser. In my previous article, I used a server side technology (PhantomJS) to do the heavy lifting. In this example, we are going to use a browser bookmarklet to make the task even easier.

Navigate to :

Web Page Scraper by @mikeptweet_From any Web Page, click on the link (the one you dragged to your browser) to activate the Add-in_s3.amazonaws.com

and drag the “Web Page Scraper” link to your browser toolbar:

Then from any web page, click on the Bookmarklet (that is the single mouse click) to scrape the web page.

NOTE: You have to allow popups as the Web Page Scraper uses an external browser window.

You should see something that looks like this:

The Web Page Scraper loads a few default columns but you can choose from a bunch of other columns by right clicking on the column headers:

You can move columns around as well as filter and sort on the columns:

Once you have the data that you need, you can export it in a bunch of formats, including Excel, JSON, HTML, TAB and Comma Delimited. Just right click on the grid to export:

This is a work in progress and you many notice that performance on pages with lots of elements is slow. I’m working on this :-)

Also, I am working on adding a bunch of additional features that will make this utility even more useful. I’ll be posting an article on that soon.

Please recommend this and my other articles if you like it!

Mike Parsons - Medium_Read writing from Mike Parsons on Medium. Software Research Geek. Every day, Mike Parsons and thousands of other voices…_medium.com

Thanks.


Published by HackerNoon on 2017/01/26