Kafka Streams in Python Using Faust Streaming

🔗 Post on Kitopi Blog

Description

Stream processing is a programming paradigm according to which input and output data is viewed as a continuous stream manipulated by the processor. Confluent Inc. has introduced the Kafka stream processing concept along with the Kafka Streams client - for Java/Scala applications. The idea of a Kafka stream “represents an unbounded, continuously updating data set.” Faust Streaming, an actively maintained fork of the Faust library, is a great tool for implementing the Kafka Streams concept in Python. It has proven to be fast, reliable, and easy to use in our production environment.

In the post I present the implementation of Streams using Python library - Faust