Spark

­­The Rise of the Durable Execution Engine (Temporal, Restate) in an Event-driven Architecture (Apache Kafka)

Durable execution engines like Temporal and Restate are redefining how developers orchestrate long-running, stateful workflows in distributed systems. Unlike traditional…

3 months ago

Confluent Data Streaming Platform vs. Databricks Data Intelligence Platform for Data Integration and Processing

This blog explores how Confluent and Databricks address data integration and processing in modern architectures. Confluent provides real-time, event-driven pipelines…

4 months ago

The Past, Present, and Future of Confluent (The Kafka Company) and Databricks (The Spark Company)

Confluent and Databricks have redefined modern data architectures, growing beyond their Kafka and Spark roots. Confluent drives real-time operational workloads;…

5 months ago

Fraud Detection in Mobility Services (Ride-Hailing, Food Delivery) with Data Streaming using Apache Kafka and Flink

Mobility services like Uber, Grab, and FREE NOW (Lyft) rely on real-time data to power seamless trips, deliveries, and payments.…

5 months ago

The Data Streaming Landscape 2025

Data streaming is a new software category. It has grown from niche adoption to becoming a fundamental part of modern…

9 months ago

The Data Streaming Landscape 2023

Data streaming is a new software category to process data in motion. Apache Kafka is the de facto standard used…

3 years ago

The Heart of the Data Mesh Beats Real-Time with Apache Kafka

If there were a buzzword of the hour, it would undoubtedly be "data mesh"! This new architectural paradigm unlocks analytic…

3 years ago

Kappa Architecture is Mainstream Replacing Lambda

Real-time data beats slow data. That's true for almost every use case. Nevertheless, enterprise architects build new infrastructures with the…

4 years ago

Can Apache Kafka Replace a Database?

Can and should Apache Kafka replace a database? How long can and should I store data in Kafka? How can…

6 years ago

Big Data Spain: Talk about KSQL – The Streaming SQL Engine for Apache Kafka

KSQL - The Open Source Streaming SQL Engine for Apache Kafka => Slides from my talk at Big Data Spain…

7 years ago