Improving Our MongoDB Write Throughput with SQSby@natanavra
317 reads

Improving Our MongoDB Write Throughput with SQS

tldt arrow
Read on Terminal Reader
Read this story w/o Javascript

Too Long; Didn't Read

Amazon Simple Queue (SQS) is a highly scalable managed message queue service. It lets you decouple different parts of your application and eliminate throughput bottlenecks. At PurpleAds, our mongo servers were having a hard time keeping up with increasing numbers of write and update operations. The MongoDB CPU Average, at peak times it was at 97% average and crashed daily, so we decided to queue these ops and do periodical bulk writes instead, this would cut down the number of upsert operations by at least 10x.

Company Mentioned

Mention Thumbnail
featured image - Improving Our MongoDB Write Throughput with SQS
Natan Abramov HackerNoon profile picture

@natanavra

Natan Abramov

Co-founder @ ProveSource, PurpleAds and Valuad


Receive Stories from @natanavra

react to story with heart

RELATED STORIES

L O A D I N G
. . . comments & more!