Kai Waehner

263 posts
builds cloud-native event streaming infrastructures for real-time data processing and analytics
Python Kafka Quix Streams and Flink for Open Source Stream Processing
Read More
  • 23 views
  • 11 minute read

Quix Streams – Stream Processing with Kafka and Python

Over 100,000 organizations use Apache Kafka for data streaming. However, there is a problem: The broad ecosystem lacks a mature client framework and managed cloud service for Python data engineers. Quix Streams is a new technology on the market trying to close this gap. This blog post discusses this Python library, its place in the Kafka ecosystem, and when to use it instead of Apache Flink or other Python- or SQL-based substitutes.
Read More
0
0
0
From Smart Factory to Cloud with Data Streaming
Read More
  • 41 views
  • 4 minute read

Data Streaming from Smart Factory to Cloud

A smart factory organizes itself without human intervention to produce the desired products. This blog post explores how data streaming powered by Apache Kafka helps connect and move data to the cloud at scale in real-time, including a case study from BMW and a simple lightboard video about the related enterprise architecture.
Read More
0
0
0
Business Process Automation and BPM Workflow Engine and Orchestration with Apache Kafka
Read More
  • 208 views
  • 15 minute read

Apache Kafka as Workflow and Orchestration Engine

Business process automation with a workflow engine or BPM suite has existed for decades. However, using the data streaming platform Apache Kafka as the backbone of a workflow engine provides better scalability, higher availability, and simplified architecture. This blog post explores case studies across industries to show how enterprises like Salesforce or Swisscom implement stateful workflow automation and orchestration with Kafka.
Read More
0
0
0
The State of Data Streaming for Retail in 2023
Read More
  • 94 views
  • 8 minute read

The State of Data Streaming for Retail in 2023

This blog post explores the state of data streaming for the retail industry in 2023 with omnichannel customer experiences, hybrid shopping models, and hyper-personalized recommendations. Data streaming allows integrating and correlating data in real time at any scale. I explore customer stories from Walmart, Albertsons, Otto, AO.com, and more, including a slide deck and on-demand video recording.
Read More
0
0
0
Data Streaming is not a Race it is a Journey
Read More
  • 81 views
  • 11 minute read

Data Streaming is not a Race, it is a Journey!

Data Streaming is not a race, it is a journey! Event-driven architectures and technologies like Apache Kafka or Apache Flink require a mind shift in architecting, developing, deploying, and monitoring applications. This blog post explores success stories from data streaming journeys across industries, including banking, retail, insurance, manufacturing, healthcare, energy & utilities, and software companies.
Read More
0
0
0
The State of Data Streaming for Financial Services in 2023
Read More
  • 111 views
  • 9 minute read

The State of Data Streaming for Financial Services in 2023

This blog post explores the state of data streaming for financial services in 2023. The evolution of capital markets, retail banking and payments requires easy information sharing and open architecture. Data streaming allows integrating and correlating data in real-time at any scale. The foci are trending enterprise architectures for data streaming and customer stories. A complete slide deck and on-demand video recording are included.
Read More
0
0
0
The State of Data Streaming for Manufacturing in 2023
Read More
  • 209 views
  • 6 minute read

The State of Data Streaming for Manufacturing in 2023

This blog post explores the state of data streaming for manufacturing in 2023. The evolution of industrial IoT, manufacturing 4.0, and digitalized B2B and customer relations require modern, open, and scalable information sharing. The foci are trending enterprise architectures in the manufacturing industry and data streaming customer stories from BMW, Mercedes, Michelin, or Siemens. A complete slide deck and on-demand video recording are included.
Read More
0
0
0
JMS Message Broker vs Apache Kafka Data Streaming
Read More
  • 276 views
  • 6 minute read

Message Broker and Apache Kafka: Trade-Offs, Integration, Migration

A Message broker has very different characteristics and use cases than a data streaming platform like Apache Kafka. Data integration, processing, governance, and security must be reliable and scalable across the business process. This blog post explores the capabilities of message brokers, the relation to the JMS standard, trade-offs compared to data streaming with Apache Kafka, and typical integration and migration scenarios.
Read More
0
0
0
Global Supply Chain with IoT and Data Streaming
Read More
  • 160 views
  • 8 minute read

Transforming the Global Supply Chain with Data Streaming and IoT

The research company IoT Analytics found eight key technologies transforming the future of the global supply chain. This article explores how data streaming helps to innovate in this area. Real-world case studies from global players such as BMW, Bosch, and Walmart show the value of real-time data streaming to improve the supply chain by building use cases such as automated intralogistics, track and trace of vehicles, and proactive and context-specific decision-making with MES and ERP integration. 
Read More
0
0
0
Apache Kafka and Apache Flink for Open Source and Cloud-native Data Streaming
Read More
  • 530 views
  • 12 minute read

Apache Kafka (including Kafka Streams) + Apache Flink = Match Made in Heaven

Apache Kafka and Apache Flink are increasingly joining forces to build innovative real-time stream processing applications. This blog post explores the benefits of combining both open-source frameworks, shows unique differentiators of Flink versus Kafka, and discusses when to use a Kafka-native streaming engine like Kafka Streams instead of Flink.
Read More
1
0
0