Kafka - Docker

> Data Integration Tool (ETL/ELT) > Kafka (Event Hub)

1 - About

Docker usage in Confluent.

Advertising

3 - Installation

3.1 - Local

The docker host must:

  • use virtualbox as provider
  • have a minimal of 6000 as virtual memory

In docker machine command line, it means:

docker-machine create --driver virtualbox --virtualbox-memory 6000 hostname

In virtualbox, you can confirm that the memory size is above 6Mb.

3.2 - Provider (Provision)

3.3 - Host file

When playing around with services, they are generally made available through the docker host.

I create then a name for each services:

192.168.99.100   broker
192.168.99.100   connect
192.168.99.100   zookeeper
192.168.99.100   schema_registry
192.168.99.100   control_center

where : 192.168.99.100 is the docker host ip

Advertising

4 - Image

4.1 - DockerFile

4.2 - Compose Yaml

Example: confluentinc/cp-docker-images/tree/3.3.x/examples

See:

4.2.1 - Debezium

4.3 - List

5 - Documentation / Reference

Advertising