Methodology Of Autoscaling For Kinesis Streams

Too Long; Didn't Read

AWS doesn’t support auto-scaling for kinesis streams most of the time we either over provision the shards and pay more or under provision them and taking a hit on the performance. Using a combination of cloud watch alarms, SNS topics and Lambda we can implement auto-scale up and scale down. We can also use “Incoming.Records. bytes” metrics of the stream to implement the same solution. We scale up really quick so we’re hitting the right balance between cost and performance. We scale down slowly so we can avoid too many scale. operations. We use the “Scale out alarm” to scale down quickly.