flink Archives - Kai Waehner

569 views
10 minute read

How to Build a Real-Time Advertising Platform with Apache Kafka and Flink

ByKai Waehner
15. September 2023
No comments

An advertising platform requires real-time capabilities to provide dynamic targeting, ad personalization, ad fraud detection, budget allocation, and event-driven marketing. This blog post explores how data streaming with Apache Kafka and Apache Flink enables context-specific advertising at any scale. Real-world success stories from Pinterest, Uber, Unity, buzzwil, and TV-Insight show different solutions and architectures for serving ads in marketing campaigns, embedded into mobile apps, and as SaaS software products.

The State of Data Streaming for Energy and Utilities in 2023

465 views
8 minute read

The State of Data Streaming for Energy & Utilities in 2023

ByKai Waehner
1. September 2023
No comments

The evolution of utility infrastructure, energy distribution, customer services, and new business models requires real-time end-to-end visibility, reliable and intuitive B2B and B2C communication, and integration with pioneering technologies like 5G for low latency or augmented reality for innovation. I look at trends in the utilities sector to explore how data streaming helps as a business enabler, including customer stories from SunPower, 50hertz, Powerledger, and more. A complete slide deck and on-demand video recording are included.

785 views
8 minute read

The State of Data Streaming for Digital Natives in 2023

ByKai Waehner
18. July 2023
No comments

This blog post explores the state of data streaming in 2023 for digital natives born in the cloud. Data streaming allows integrating and correlating data in real-time at any scale to improve the most innovative applications leveraging Apache Kafka. I explore how data streaming helps as a business enabler, including customer stories from New Relic, Wix, Expedia, Apna, Grab, and more. A complete slide deck and on-demand video recording are included.

Business Process Automation and BPM Workflow Engine and Orchestration with Apache Kafka

2.5K views
15 minute read

Apache Kafka as Workflow and Orchestration Engine

ByKai Waehner
8. May 2023
No comments

Business process automation with a workflow engine or BPM suite has existed for decades. However, using the data streaming platform Apache Kafka as the backbone of a workflow engine provides better scalability, higher availability, and simplified architecture. This blog post explores case studies across industries to show how enterprises like Salesforce or Swisscom implement stateful workflow automation and orchestration with Kafka.

525 views
8 minute read

The State of Data Streaming for Retail in 2023

ByKai Waehner
27. April 2023
No comments

This blog post explores the state of data streaming for the retail industry in 2023 with omnichannel customer experiences, hybrid shopping models, and hyper-personalized recommendations. Data streaming allows integrating and correlating data in real time at any scale. I explore customer stories from Walmart, Albertsons, Otto, AO.com, and more, including a slide deck and on-demand video recording.

Apache Kafka and Apache Flink for Open Source and Cloud-native Data Streaming

3.3K views
12 minute read

Apache Kafka (including Kafka Streams) + Apache Flink = Match Made in Heaven

ByKai Waehner
23. January 2023
1 share
No comments

Apache Kafka and Apache Flink are increasingly joining forces to build innovative real-time stream processing applications. This blog post explores the benefits of combining both open-source frameworks, shows unique differentiators of Flink versus Kafka, and discusses when to use a Kafka-native streaming engine like Kafka Streams instead of Flink.

Data Streaming Landscape 2023 with Apache Kafka Flink and much more

1.8K views
13 minute read

The Data Streaming Landscape 2023

ByKai Waehner
21. December 2022
1 share
3 comments

Data streaming is a new software category to process data in motion. Apache Kafka is the de facto standard used by over 100,000 organizations. Plenty of vendors offer Kafka platforms and cloud services. Many complementary stream processing engines like Apache Flink and SaaS offerings have emerged. And competitive technologies like Pulsar and Redpanda try to get market share. This blog post explores the data streaming landscape of 2023 to summarize existing solutions and market trends.

Fraud Detection and Prevention with Apache Kafka KSQL Apache Flink

2.2K views
5 minute read

Fraud Detection with Apache Kafka, KSQL and Apache Flink

ByKai Waehner
25. October 2022
3 shares
No comments

Fraud detection becomes increasingly challenging in a digital world across all industries. Real-time data processing with Apache Kafka became the de facto standard to correlate and prevent fraud continuously before it happens. This blog post explores case studies for fraud prevention from companies such as Paypal, Capital One, ING Bank, Grab, and Kakao Games that leverage stream processing technologies like Kafka Streams, KSQL, and Apache Flink.