Please Dont Build Your Data Pipeline using Singer

Written by jean-lafleur | Published 2021/06/19
Tech Story Tags: data | open-source | data-infrastructure | data-integration | etl | elt | software-development | pipeline

TLDR Singer.io is an open-source tool that makes it easy to pipe data from one tool to another. At Airbyte, we spent time determining if we could leverage Singer to programmatically send data from any of their supported data sources (taps) to any supported data destinations (targets) These gotchas illustrate some of the core primitives that a programmatic data integration tool requires. In order to use most Singer taps, you need to scour the entire implementation to figure out what properties it uses.via the TL;DR App

no story

Written by jean-lafleur | Co-founder at Airbyte.io, the new standard for open-source data integration
Published by HackerNoon on 2021/06/19