Too Long; Didn't Read
In our <a href="https://blog.socialcops.com/technology/data-science/apache-airflow-disease-outbreaks-india/" target="_blank">last post on Apache Airflow</a>, we mentioned how it has taken the data engineering ecosystem by storm. We also talked about how we’ve been using it to move data across our internal systems and explained the steps we took to create an internal workflow. The ETL workflow (e)xtracted PDFs from a website, (t)ransformed them into CSVs and (l)oaded the CSVs into a store. We also touched briefly on the breadth of ETL use cases you can solve for, using the Airflow platform.