Data Pipelines: OpenWeatherMap-Airflow [A How-To Guide]

Written by ashish-ghimire | Published 2020/02/18
Tech Story Tags: data-pipeline | etl | airflow | api | how-to-develop-etl-pipeline | setup-database-etl-pipeline | setup-airflow-etl-pipeline | amaoche-airflow-etl-pipeline

TLDR In this article, we will learn how to develop ETL(Extract Transform Load) pipeline using Apache Airflow. In order to use Airflow, you will have to set up Airflow first. We will then create a directory where we will save daily data obtained from API. The code for this article can be found in this Github Repository. You can see Airflow installation documentation on how to setup Airflow. You can find it over the GitHub Repository. This article is developed using Michael Harmon's publication.via the TL;DR App
no story
Published by HackerNoon on 2020/02/18
ABOUTHow hackers start their afternoons. We publish tech stories and build publishing software.

READEntirely free library read by hundreds of millions to learn anything about any technology.

WRITEHackerNoon elevates quality technology writing far and wide across the interwebs.

PARTNERHackerNoon works directly with tech companies to place ads by content relevancy