Improving Our MongoDB Write Throughput with SQS

Written by natanavra | Published 2021/11/18
Tech Story Tags: npm | amazon-sqs | nodejs | mongodb | sqs | mongodb-write-throughput | ecommerce | data

TLDRAmazon Simple Queue (SQS) is a highly scalable managed message queue service. It lets you decouple different parts of your application and eliminate throughput bottlenecks. At PurpleAds, our mongo servers were having a hard time keeping up with increasing numbers of write and update operations. The MongoDB CPU Average, at peak times it was at 97% average and crashed daily, so we decided to queue these ops and do periodical bulk writes instead, this would cut down the number of upsert operations by at least 10x.via the TL;DR App

no story

Written by natanavra | Co-founder @ ProveSource, PurpleAds and Valuad
Published by HackerNoon on 2021/11/18