Lambda Architecture Serving Layer: Real-Time Visualization For Taxi [Part 2]

Written by srivassid | Published 2020/12/21
Tech Story Tags: python | kafka | cap-theorem | hackernoon-top-story | data-pipeline | optimization | lambda-architecture | kibana | web-monetization

TLDR Serving layer is derived either by performing computation on batch data to arrive at a view that is mid way from speed layer and batch layer, or by collecting enough data for a window (whose size varies from application to application) from the speed layer. Serving layer allows for data to be indexed and privides interface to access the precomputed data. In this post i will talk about how that, by aggregating data for smaller interval (than the range of the whole dataset) by presenting some visualizations.via the TL;DR App

no story

Written by srivassid | Data Engineer
Published by HackerNoon on 2020/12/21