Using Rate Limiting Algorithms for Data Processing Pipelinesby@valerio-barbera
2,126 reads
2,126 reads

Using Rate Limiting Algorithms for Data Processing Pipelines

by Inspector.dev4mFebruary 7th, 2022
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

In Inspector the Rate Limiter protects the datastore from inadvertent or malicious overuse by limiting the rate at which an application can store monitoring data. Rate limiting algorithm divides the timeline into fixed-size windows and assigns a counter to each window. If the counter in the window has reached the limit, requests falling in this window should be rejected. If a window is exceeded, requests that exceed the limit are re-scheduled again onto the messages queue, waiting for a time window with free capacity.

Company Mentioned

Mention Thumbnail
featured image - Using Rate Limiting Algorithms for Data Processing Pipelines
Inspector.dev HackerNoon profile picture
Inspector.dev

Inspector.dev

@valerio-barbera

Simple Code Execution Monitoring, built for developers

Share Your Thoughts

About Author

Inspector.dev HackerNoon profile picture
Inspector.dev@valerio-barbera
Simple Code Execution Monitoring, built for developers

TOPICS

THIS ARTICLE WAS FEATURED IN...

Permanent on Arweave
Read on Terminal Reader
Read this story in a terminal
 Terminal
Read this story w/o Javascript
Read this story w/o Javascript
 Lite
Also published here
L O A D I N G
. . . comments & more!