These days Schema Registry is “the” tool if you want to work with schemas in your Kafka cluster. It keeps track of different versions, allows for compatibility between schemas, has support for different format types (json, avro, protobuf,…) and much more. If at this point all of this is a…

The SaaS industry has grown tremendously these past couple of years but with that growth comes the ever demanding question to analyse that data. Most SaaS solutions bring their own “analytics” plugin, at a hefty sum in most cases, but are still operating in silos (you usually can’t upload your…

In my previous story I explained a bit on what serialization is and how we can implement it in Python. The libraries we briefly touched were Apache Thrift and Pickle. Today we will have a look at an other popular framework from Google, namely “Protocol Buffers”. Just like Apache thrift…

What is data serialization ? Data serialization is a process in which we convert data to an object, which will allow us to share that object between internal and external processes in a uniform way. …

What is mlFlow? mlFlow is a framework that supports the machine learning lifecycle. This means that it has components to monitor your model during training and running, ability to store models, load the model in production code and create a pipeline. The framework introduces 3 distinct features each with it’s own capabilities. MlFlow Tracking Tracking…

Template Yes a template for a java repository to speed up the CI/CD part. Nothing exciting but while building my latest project there were some pieces of the puzzle that were missing and frustrating. If I had a template, it would have shaven a day off building the damn repo. So…

Why ???

In our previous story we explained how to set up a Kafka kubernetes cluster. Next we are going to explore how we can send messages to Kafka. …

Start of our tale Kafka is gaining more popularity across the open source community and there are countless ways of running Kafka. Some like to run it on dedicated (virtual) machines, others prefer a PAAS solution. Lastly, you have a mix of solutions, this is were we will go exploring. Technology stack