Kafka - Docker

About

Docker usage in Confluent.

Articles Related

Installation

Local

The docker host must:

• use virtualbox as provider
• have a minimal of 6000 as virtual memory

In docker machine command line, it means:

docker-machine create --driver virtualbox --virtualbox-memory 6000 hostname

In virtualbox, you can confirm that the memory size is above 6Mb.

Provider (Provision)

• https://docs.docker.com/machine/examples/aws/
• https://docs.docker.com/machine/examples/ocean/

Host file

When playing around with services, they are generally made available through the docker host.

I create then a name for each services:

192.168.99.100   broker
192.168.99.100   connect
192.168.99.100   zookeeper
192.168.99.100   schema_registry
192.168.99.100   control_center

where : 192.168.99.100 is the docker host ip

Image

DockerFile

confluentinc/cp-docker-images/tree/3.3.x/debian

Compose Yaml

Example: confluentinc/cp-docker-images/tree/3.3.x/examples

See:

• One docker image: docker-demo-base All in one. See Sqlite Standalone on how to use it.
• Several containers: Kafka Connect - Sqlite in Distributed Mode
• Single Node: Multiple docker image (Services), One Broker : Kafka - Docker Single Node (Multiple Service Broker + Zookeeper)
• Single Node: Multiple docker image (Services), N Broker, N Zookeeper : Cluster

Debezium

• https://github.com/debezium/docker-images
• Debezium

List

• https://github.com/wurstmeister/kafka-docker

Documentation / Reference

• https://docs.confluent.io/current/cp-docker-images/docs/intro.html
• confluentinc/cp-docker-images/
• Docker build with Jenkins containing Connectors