Understanding Kafka Partitions: How to Get the Most out of Your Kafka Clusterby@instaclustr

Understanding Kafka Partitions: How to Get the Most out of Your Kafka Cluster

tldt arrow
Read on Terminal Reader
Read this story w/o Javascript

Too Long; Didn't Read

This blog provides an overview around the two fundamental concepts in Apache Kafka: Topics and Partitions. A topic is divided into 1 or more partitions, enabling producer and consumer loads to be scaled. The size (in terms of messages stored) of partitions is limited to what can fit on a single node. Partitions can have copies to increase durability and availability, and enables Kafka to failover to a broker with a replica of the partition if the broker with the leader partition fails. This is called the Replication Factor and can be configured cluster wide or set/checked per topic.

Companies Mentioned

Mention Thumbnail
Mention Thumbnail

Coin Mentioned

Mention Thumbnail
featured image - Understanding Kafka Partitions: How to Get the Most out of Your Kafka Cluster
instaclustr HackerNoon profile picture

@instaclustr

instaclustr

Instaclustr helps organizations deliver applications at scale by operating and supporting their data infrastructure.


Receive Stories from @instaclustr

react to story with heart

RELATED STORIES

L O A D I N G
. . . comments & more!