Kafka - Tutorials
About
A list of tutorials that I made on windows.
They were my path to learn Kafka
Most of the tutorial on the confluent website are working only on Linux. When you try to follow them directly on Windows, you see quickly that it will not work. For instance, the confluent utility was not yet available on Windows. To resolve this issue, all the tutorial are launching Kafka through Docker Container that runs on Linux. It may add a little bit more complexity but you will then be able to start multiple node.
List
Single node - Getting Started
In this tutorial:
- you start all services in a docker container
Tutorial: Kafka - Docker Single Node (Multiple Service Broker + Zookeeper)
Connect Standalone with Sqlite
In this tutorial:
- you start all services in a docker container
- you write data into a topic from a Sqlite database with a connect worker started in a standalone mode (ie single process, no worker cluster)
- you add a column to the sqlite table and see that the jdbc connector is able to follow this schema evolution.
Tutorial: Sqlite Standalone
Connect Distributed with Sqlite
In this tutorial:
- each service is started in its own docker container (They have then a different IP and hostname).
- You write data into a topic from a Sqlite database with a connect worker started in a distributed mode (even if there is only one worker, the worker is part of a cluster and you configure it with the Connect rest Api)
- You read data from the kafka-avro-console-consumer
Tutorial: Kafka Connect - Sqlite in Distributed Mode
Stream Word Count
Tutorial: Kafka - Stream Word Count demo