Designing an API Rate Limiter
by NK3mFebruary 10th, 2023 Too Long; Didn't Read
Distributed systems implement an API rate limiter for high availability and security. The throttle cache uses a write-behind cache pattern by storing the throttle data on the message queue to improve the latency. The dropped requests are stored in the queue for analytics and auditing purposes.