When we write a message to a topic in Kafka, it goes to one of the partitions of the topic. While Kafka provides automatic partitioning, we can also provide our own custom partitioning logic. In this post, we will learn how to use the Kafka Custom Partitioner in a Java Read more…
Kafka Producer Acks configuration property can often confuse developers. However, it is one of the most important properties in making sure you don’t end up loosing messages. Basically, the Kafka Producer Acks property controls how many replicas of a partition must receive the message or record before the Producer can Read more…
Whatever be our use-case for Kafka, we will always have a Producer that writes data to Kafka and a Consumer that reads data from Kafka. In this post, we will uncover the mysteries of Kafka Producer with examples. If you are new to Kafka, check out our detailed Kafka Introduction. Read more…
Over the years, Kafka has become super popular among developers and large organizations. What began as an internal project at LinkedIn has turned into one of the most significant components of event-driven systems. It is used in some of the largest data pipelines in the world and organizations such as Read more…
In this post, we will look at the step-by-step process for Kafka Installation on Windows. Kafka is an open-source stream processing software platform and comes under the Apache software foundation. Over the last few years, Kafka’s growth has exploded. More and more fortune-500 companies are adopting Kafka. On a practical Read more…
In a distributed system, it is crucial to deal with bad messages properly. Failures are bound to happen. RabbitMQ Dead Letter Queue helps in dealing with bad messages by allowing us to catch those messages and do something with them. With Spring Cloud Stream, it becomes even more easy to Read more…
Fanout Pattern is a commonly used pattern while implementing publish and subscribe between microservices. In this post, we will be looking at the process of Implementing RabbitMQ Fanout Exchange using Spring Cloud Stream. If you are completely new to Spring Cloud Stream and RabbitMQ, I strongly recommend going through my Read more…
Communication between microservices is the backbone of distributed systems. Usually, developers try to avoid it altogether fearing an increase in complexity. However, a combination of Spring Cloud Stream and RabbitMQ can make it relatively easy to handle communication between microservices. Spring Cloud Stream is also part of the Spring Cloud Read more…
