Using Rate Limiting Algorithms for Data Processing Pipelinesby@valerio-barbera
1,543 reads

Using Rate Limiting Algorithms for Data Processing Pipelines

tldt arrow
Read on Terminal Reader🖨️

Too Long; Didn't Read

In Inspector the Rate Limiter protects the datastore from inadvertent or malicious overuse by limiting the rate at which an application can store monitoring data. Rate limiting algorithm divides the timeline into fixed-size windows and assigns a counter to each window. If the counter in the window has reached the limit, requests falling in this window should be rejected. If a window is exceeded, requests that exceed the limit are re-scheduled again onto the messages queue, waiting for a time window with free capacity.

Company Mentioned

Mention Thumbnail
featured image - Using Rate Limiting Algorithms for Data Processing Pipelines
Inspector.dev HackerNoon profile picture

@valerio-barbera

Inspector.dev

react to story with heart

RELATED STORIES

L O A D I N G
. . . comments & more!
Hackernoon hq - po box 2206, edwards, colorado 81632, usa