Terraform is a deployment tool that you can use to provision and manage your infrastructure as code. Usually, the infrastructure is cloud-based but Terraform can manage anything that can be controlled through an API. But why should you consider infrastructure as code (IaC) in the first place? IaC helps avoid Read more…
Infrastructure as Code or IAC is one of the core pillars of effective platform engineering. And Terraform is a very popular IAC tool that makes it extremely easy to provision infrastructure. In this post, you will learn how to use Terraform to provision a Nginx Docker Container. This will help Read more…
When we write a message to a topic in Kafka, it goes to one of the partitions of the topic. While Kafka provides automatic partitioning, we can also provide our own custom partitioning logic. In this post, we will learn how to use the Kafka Custom Partitioner in a Java Read more…
Kafka Producer Acks configuration property can often confuse developers. However, it is one of the most important properties in making sure you don’t end up loosing messages. Basically, the Kafka Producer Acks property controls how many replicas of a partition must receive the message or record before the Producer can Read more…
Whatever be our use-case for Kafka, we will always have a Producer that writes data to Kafka and a Consumer that reads data from Kafka. In this post, we will uncover the mysteries of Kafka Producer with examples. How Kafka Producer works under the hood? How to create a Kafka Read more…
Over the years, Kafka has become super popular among developers and large organizations. What began as an internal project at LinkedIn has turned into one of the most significant components of event-driven systems. It is used in some of the largest data pipelines in the world and organizations such as Read more…
Sidecar pattern is a design approach in which application responsibilities are segregated into a separate process. Basically, this pattern allows us to add more capabilities to an applicational without additional addition of third-party components. In this post, we will look at Sidecar Design Pattern with a Kubernetes Pod deployment. However, Read more…
While Redis is popular as a caching and data storage solution for application, it is also a great tool to implement a publish-subscribe interaction. However, publish-subscribe pattern often sounds complicated to implement. On the contrary, implementing Redis PubSub in NodeJS is quite simple and straightforward. To implement Redis PubSub in Read more…
Redis is based on a typical client-server model. In other words, it uses a request-response approach to handle requests. With Redis Pipeline, we can improve upon the request processing aspects. In this post, we will learn how to create a Redis Pipeline in NodeJS using the popular IORedis package. In Read more…
In this post, we will learn how to create a NestJS Redis Microservice. Basically, we will learn how to use the Redis transporter. This transporter leverages the publish/subscribe messaging paradigm. This post uses the NestJS Microservice package. If you are new to the same, please refer to this detailed post Read more…
