Methodology Of Autoscaling For Kinesis Streams

Written by hariohmprasath | Published 2020/07/03
Tech Story Tags: aws | kinesis | aws-lambda | stream-processing | autoscaling | event-streaming | tutorial | coding

TLDR AWS doesn’t support auto-scaling for kinesis streams most of the time we either over provision the shards and pay more or under provision them and taking a hit on the performance. Using a combination of cloud watch alarms, SNS topics and Lambda we can implement auto-scale up and scale down. We can also use “Incoming.Records. bytes” metrics of the stream to implement the same solution. We scale up really quick so we’re hitting the right balance between cost and performance. We scale down slowly so we can avoid too many scale. operations. We use the “Scale out alarm” to scale down quickly.via the TL;DR App

no story

Written by hariohmprasath | https://www.linkedin.com/in/hariohmprasath/
Published by HackerNoon on 2020/07/03