Home » Kafka

Tag Archives: Kafka

Kafka & Zookeeper for Development: Zookeeper Ensemble

java-interview-questions-answers

Previously we spun up Zookeeper and Kafka locally but also through Docker. What comes next is spinning up more than just one Kafka and Zookeeper node and create a 3 node cluster. To achieve this the easy way locally docker-compose will be used. Instead of spinning up various instances on the cloud or running various Java processes and altering configs, ...

Read More »

Kafka & Zookeeper for Development: Local and Docker

java-interview-questions-answers

Kafka popularity increases every day more and more as it takes over the streaming world. It is already provided out of the box on cloud providers like AWS, Azure and IBM Cloud. Eventually for cases of local development it is a bit peculiar due to requiring various moving parts. This blog will focus on making it easy for a developer ...

Read More »

It is never enough of them: enriching Apache Avro generated classes with custom Java annotations

Apache Avro, along with Apache Thrift and Protocol Buffers, is often being used as a platform-neutral extensible mechanism for serializing structured data. In the context of event-driven systems, the Apache Avro‘s schemas play the role of the language-agnostic contracts, shared between loosely-coupled components of the system, not necessarily written using the same programming language. Probably, the most widely adopted reference ...

Read More »

Kafka – Exactly-Once Semantics

java-interview-questions-answers

In distributed environment failure is a very common scenario that can be happened any time. In the Kafka environment, the broker can crash, network failure, failure in processing, failure while publishing message or failure to consume messages, etc. These different scenarios introduced a different kind of data loss and duplication. Failure scenarios A (Ack Failed): Producer published message successfully with retry>1 ...

Read More »