The most talented developers in the world can be found on . What if there was an easy, fast and free way to find, rank and recruit them? I'll show you exactly how to to this in less than a minute using free tools and a process that I've hacked together to vet top . GitHub tech talent at BizPayO For many of the side-projects I work on collaborating with the best developers in machine learning/AI, blockchain and cryptocurrency are often a matter of checking out the most popular projects on GitHub then with open-source projects. helping each other This is a short tutorial on how to scrape data on the top developers from GitHub and export quickly into a spreadsheet. : Use Cases Find the most talented developers to collaborate with (i.e. most followed JavaScript developers in San Francisco, CA) Recruit top developers based on their skillset and collaboration activity The best part is that these free tools are not limited to just GitHub. You can use them for these other use cases: Finding the best products and prices on Amazon or Ebay Getting business contact details from YP or Yelp (i.e. building an outreach list with highly rated successful businesses)Let’s Begin In this example we’ll scrape GitHub to find the names, location, and if provided email for the . most followed JavaScript developers in San Francisco You’ll only need two Chrome extensions, and , both free in the Google Chrome Store. Autopagerize Instant Data Scraper Autopagerize simply allows you to auto-load any paginated website. It works in all major browsers including Firefox, Chrome, Opera and Safari. Instant Data Scraper is a uses AI to detect tabular or listing type data on web pages. Such data can be scraped into CSV or Excel file, no coding skills required. This extension can also click on the “Next” page links or buttons and retrieve data from multiple pages into one file. Pretty sweet. : Download the Chrome plugin. It will allow appending the second, third, etc. search results pages to the bottom of the current page, creating one long page that contains all the results (or as many as you wish). As mentioned above it works in Google search results, GitHub, Amazon, Yelp and several others. Step 1 Autopagerize : Download the plugin. Step 2 Instant Data Scraper : Go to the URL you want to scrape, in this case we’re grabbing the top JavaScript developers in SF on GitHub — again here is the page to start on sorted by followers: Step 3 https://github.com/search?l=JavaScript&o=desc&p=7&q=stars%3A%3E1000+location%3A%22San+Francisco%22+location%3ACA+followers%3A%3E10+language%3AJavaScript&s=followers&type=Users Fun fact: The first guy’s last name is pronounced “Boss”-Stock. Pretty bad-ass huh? : Click the Autopagerize plugin in your browser then click Next for as many pages as you need. You’ll then have a list similar to the following: Step 4 That’s it! You should now have a list of all the data based on the above criteria. Again this method can be used for other popular sites to quickly gather, extract and sort the data that you need. If you’ve found this article helpful please share so that others can find it. If you have any questions feel free to reply or reach out to me directly on Twitter . @marcbegins Happy scraping!

Amazon

eBay

Google

Twitter

Lets Crowdsource Coronavirus Resources, Grants, Discounts and Freebies

How Likely Is Your Job to be Automated?

Co-founder @BizPayO

Read My Stories

Too Long; Didn't Read

How To Scrape Amazon, Yelp and GitHub Profiles in 30 Seconds

How To Scrape Amazon, Yelp and GitHub Profiles in 30 Seconds

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Untitled Story

Forecasting Bitcoin Price With Crowdsourced Algorithms: Part II

116 Stories To Learn About Web Scraping

3 Mejores Formas de Crawl Datos desde Website

5 Técnicas Anti-Scraping que Puedes Encontrar

53 Stories To Learn About Data Scraping

Forecasting Bitcoin Price With Crowdsourced Algorithms: Part II

116 Stories To Learn About Web Scraping

3 Mejores Formas de Crawl Datos desde Website

5 Técnicas Anti-Scraping que Puedes Encontrar

53 Stories To Learn About Data Scraping

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps