This is part one of a two-series on running the Apache Kafka server. All this is demonstrated step-by-step from the command line. All of this is for Apache Kafka v3.4 on Windows 10. Pre-Requisites 1. Install Java//JRE (v8.0 is used in this Example) 2. Install Apache Kafka 3.4.0 from the Given Link 3. Set Java Classpath> Set JAVA_HOME Correctly 4. UnZIP/UnTAR Apache Kafka Downloaded in (2) 5. Use a Text Editor like [Notepad++] for Editing Version 3.4.0 Apache Kafka Version 3.4.0 was Released on Feb 7, 2023, This article specifically is for the Kafka Version (2.13-3.4.0). For the purpose of this Article, I use {KAFKA_HOME} as the Windows folder where Kafka was installed. Step-By-Step Guide 0. Configure Zookeeper (Data Directory) Create a folder to hold Zookeeper Data by modifying the file (File is Located under {KAFKA_HOME}/config/). Create a Folder named ). In my case, I created this under {KAFKA_HOME}. You may then modify your properties file as shown in the image below.  Modify your to point to the newly created folder. zookeper.properties zk-data (or as per your wish dataDir 0. Configure Kafka (Kafka Logs) For the purpose of Kafka logs, you can create a folder with the name . In my case, I created this under {KAFKA_HOME}. You may then modify your properties file as shown in the image below. The property to be modified is in which should now point to the newly created folder. kafka-logs log.dirs server.properties 1. Starting Zookeeper First, Zookeeper has to be started using the following command. zookeeper-server-start.bat ..\..\config\zookeeper.properties 2. Starting Kafka Server Next, we will start the Kafka Server using the following command. D:\kafka_2.13-3.4.0\bin\windows>kafka-server-start.bat ..\..\config\server.properties 3. Creating a Test Topic Create a Kafka Topic to test out the Kafka Installation using the following command. D:\kafka_2.13-3.4.0\bin\windows>kafka-topics.bat --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test The above is an updated way to create topics in Kafka. In earlier versions of Kafka (Kafka v2), the suggested way to create topics was directly via Zookeeper. From v3, It has changed to create topics via Brokers. (Cited from StackOverflow) For ver 2.* you have to create the topic using Zookeper with the default port 2181 as a parameter. For  ver 3.* the zookeeper is not a parameter, you must use --bootstrap-server using localhost or the IP address of the server and the default port 9092. Documentation 4. Create Kafka Producer kafka-console-producer.bat --broker-list localhost:9092 --topic test 5. Create Kafka Consumer kafka-console-consumer.bat --bootstrap-server localhost:9092 --topic test --from-beginning Next in this series of articles will be the demonstration of a Core Java Kafka Producer and Consumer, followed by an article on Spring Boot-based Kafka Integration. Also published . here

Walkthroughs, tutorials, guides, and tips. This story will teach you how to do something new or how to do something better.

The code in this story is for educational purposes. The readers are solely responsible for whatever they build with it.

A Beginner's Guide to Starting Apache Kafka on Windows 10 (Kafka v3.4)

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Apache Kafka - Java Producer & Consumer Example (Kafka v3.4 on Windows 10)

The Noonification: If You Cant Beat Em, Buy Em! (10/18/2023)

The Noonification: The Conversational AI Arms Race Has Begun (2/9/2023)

3 Top Resources To Learn About Apache Kafka

47 Stories To Learn About Kafka

5 Things Every Apache Kafka Dev Needs To Know: A Performance and Architectural Deep Dive

Apache Kafka - Java Producer & Consumer Example (Kafka v3.4 on Windows 10)

The Noonification: If You Cant Beat Em, Buy Em! (10/18/2023)

The Noonification: The Conversational AI Arms Race Has Begun (2/9/2023)

3 Top Resources To Learn About Apache Kafka

47 Stories To Learn About Kafka

5 Things Every Apache Kafka Dev Needs To Know: A Performance and Architectural Deep Dive

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps