Kafka Installation & Configuration on Windows 10

1. Download & install Java

2. Create a Junction Link.  (Needed as the Java Path contains spaces)

    C:\Windows\system32>mklink /J "C:\Program_Files" "C:\Program Files"
    Junction created for C:\Program_Files <<===>> C:\Program Files

3. Set Path and Classpath for Java

4. Download and extract Apache Kafka

5. Set Path for Kafka bin/windows directory (in Environment Variables)

6. Download and extract Apache Zookeeper

7. Set Path for Zookeeper bin directory

8. Edit Zookeeper config:

    dataDir=C:\\zookeeper\\zookeeper-3.4.9\\data

9. Edit Kafka windows server.properties:

    log.dirs=C:\\kafka\\kafka_2.11-0.10.1.0\\kafka-logs

10. Run Zookeeper

    C:\> zkServer
   

11. Run Kafka Server

    C:\kafka\kafka_2.11-0.10.1.0> .\bin\windows\kafka-server-start.bat .\config\server.properties
    - OR -
    C:\> kafka-server-start.bat %KAFKA_HOME%\config\server.properties

12. Create Topic

    C:\> kafka-topics.bat --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

13. List Topics

    C:\> kafka-topics.bat --list --zookeeper localhost:2181

14. Describe Topic

    C:\> kafka-topics.bat --describe --zookeeper localhost:2181 --topic test

15. Create Producer

    C:\> kafka-console-producer.bat --broker-list localhost:9092 --topic test

16. Create Consumer

    C:\> kafka-console-consumer.bat --zookeeper localhost:2181 --topic test

17. Create Consumer (Read messages from beginning)

    C:\> kafka-console-consumer.bat --zookeeper localhost:2181 --topic test --from-beginning

18. Delete Topic

    C:\> kafka-run-class.bat kafka.admin.TopicCommand --delete --topic test --zookeeper localhost:2181

19. Stop Kafka Server

    C:\kafka\kafka_2.11-0.10.1.0> .\bin\windows\kafka-server-stop .\config\server.properties
    - OR -
    C:\> kafka-server-stop.bat %KAFKA_HOME%\config\server.properties
   

20. Terminate Zookeeper

    Press Ctrl + C
    Terminate batch job (Y/N)? Y   
---