kafka-streams-branch

Kafka Streams Branch

This module demonstrates the following:

• The usage of the Kafka Streams DSL, including branch() and peek().
• Unit testing using Topology Test Driver.

In this module, records of type <String, KafkaPerson> are streamed from a topic named PERSON_TOPIC. The following tasks are performed:

1. Split the records into different topics based on the last name of each KafkaPerson record:

• Persons with a last name starting with "S" are sent to a topic named PERSON_BRANCH_A_TOPIC. Both the first name and last name are converted to uppercase.
• Persons with a last name starting with "F" are sent to a topic named PERSON_BRANCH_B_TOPIC.
• Other persons (with last names not starting with "A" or "B") are sent to a topic named PERSON_BRANCH_DEFAULT_TOPIC.

Requirements

To compile and run this demo, you will need the following:

• Java 21
• Maven
• Docker

Running the Application

To run the application manually, please follow the steps below:

• Start a Confluent Platform in a Docker environment.
• Produce records of type <String, KafkaPerson> to a topic named PERSON_TOPIC. You can use the producer person to do this.
• Start the Kafka Streams.

To run the application in Docker, please use the following command:

docker-compose up -d

This command will start the following services in Docker:

• 1 Kafka broker KRaft
• 1 Schema registry
• 1 Control Center
• 1 producer Person
• 1 Kafka Streams Branch