Browsing Category

Apache Kafka

265 posts
MCP vs REST HTTP vs Apache Kafka -The Enterprise Architect Guide and Decision Tree to Agentic AI Integration
Read More
  • 1.9K views
  • 12 minute read

MCP vs. REST/HTTP API vs. Kafka: The Architect’s Guide to Agentic AI Integration

MCP, REST/HTTP APIs, and Apache Kafka are not alternatives. They solve different problems at different layers of the architecture. This article maps the decision: what each technology is built for, where the boundaries are, and where the real gray areas lie. Includes a comparison table and decision tree for architects.
Read More
0
0
0
Shift Left Architecture 2.0 for the Era of Agentic AI with Kafka Flink Iceberg and MCP
Read More
  • 2.1K views
  • 10 minute read

The Shift Left Architecture 2.0: Operational, Analytical and AI Interfaces for Real-Time Data Products

The Shift Left Architecture moves data integration logic into an event-driven architecture where governed data products are built once and served to multiple consumers. The original pattern covered two interfaces: operational via Apache Kafka and analytical via Apache Iceberg. This post introduces the third: AI applications via MCP, powered by a real-time context engine that gives AI agents access to current operational data. Governance spans the full data stack through enterprise catalog tools. Together, the three interfaces turn a single data streaming investment into the foundation for operational, analytical, and AI-powered enterprise software.
Read More
0
0
0
Dashboards and Queries for Apache Kafka and the Role of Context Engine for Agentic AI and Humans
Read More
  • 1.9K views
  • 7 minute read

Dashboards and Queries for Apache Kafka: Operational, Explorative, and the Role of the Context Engine

Dashboards are a popular way to make streaming data visible and useful, but they are not always the right solution. This blog post explains when dashboards make sense for Apache Kafka data and when other approaches like automation, process intelligence, or agentic AI are better suited. It outlines the three main types of queries: operational, explorative, and dashboard serving. Each type requires a different architectural approach. The post highlights the importance of data quality, schemas, and governance as the foundation for reliable systems and introduces the role of a context engine in serving both human users and AI agents. Readers will learn how to choose the right solution based on business goals, not on tool preferences.
Read More
0
0
0
Data Streaming and AI Telco Trends at MWC 2026 in Barcelona
Read More
  • 4.6K views
  • 8 minute read

Data Streaming at MWC 2026: How Apache Kafka, Flink and Agentic AI Power Telecom Trends

Mobile World Congress (MWC) 2026 highlights the shift from batch systems to real time data streaming in telecom. AI and agentic automation, network APIs, sovereign cloud, autonomous networks, and 5G monetization all depend on continuous, governed data flows at scale. A Data Streaming Platform built on Apache Kafka and Apache Flink enables operators to collect, process, and act on live data across network and business systems. It provides the foundation for applied AI, SLA enforcement, API monetization, and usage based billing. MWC shows that telecom innovation and measurable business value now rely on real time data streaming.
Read More
0
0
0
Qantas Airline Data Streaming Platform with Apache Kafka for Airline Operations
Read More
  • 3.4K views
  • 5 minute read

From Takeoff to Touchdown: Real-Time Aviation with Data Streaming at Qantas

This blog post explores how data streaming transforms airline operations by enabling real-time visibility, faster decision-making, and improved customer experience. Using Qantas as a leading example, it highlights how a modern data streaming platform powered by Apache Kafka supports flight operations, crew coordination, baggage handling, and airport collaboration. It also explains technical integrations using Kafka Connect for AIDX message processing. The Qantas story illustrates how real-time data creates tangible business value across the aviation industry.
Read More
0
0
0
Introduction Queues for Kafka - Apache Kafka QfK - One Platform for Event Streaming and Message Queues Consolidation
Read More
  • 6.8K views
  • 10 minute read

When (Not) to Use Queues for Kafka?

Apache Kafka has long been the foundation for real-time data streaming. With the release of Queues for Kafka (QfK) in Apache Kafka 4.2, it now also supports native queuing, eliminating the need for separate message queue systems for backend integration and task processing. This blog explores how Kafka bridges the gap between stream processing and message queuing, when (not) to use QfK, and how it enables a unified cloud-native integration platform for modern enterprise architectures.
Read More
0
0
0
Diskless Kafka at FinTech Robinhood for Cost-Efficient Log Analytics and Observability with WarpStream
Read More
  • 3.4K views
  • 5 minute read

Diskless Kafka at FinTech Robinhood for Cost-Efficient Log Analytics and Observability

Diskless Kafka is transforming how fintech and financial services organizations handle observability and log analytics. By using the Kafka protocol with cloud-native object storage, companies like Robinhood reduce infrastructure costs and gain elastic scalability. This article explores how Robinhood leverages Kafka, Flink, and WarpStream to build a real-time platform that supports trading, monitoring, and compliance at scale.
Read More
0
0
0
Data Streaming in Automotive Industry with Apache Kafka and Flink for Connected Vehicles Cars using Shift Left Architecture Telemetry Signal Processing
Read More
  • 4.2K views
  • 9 minute read

Shift Left in Automotive: Real-Time Intelligence from Vehicle Telemetry with Data Streaming at Rivian

Rivian and Volkswagen, through their joint venture RV Tech, process high-frequency telemetry from connected vehicles using Apache Kafka and Apache Flink. With a shift left architecture and smart filtering, they reduced data volume by 88 percent and enabled over 250 downstream consumer applications to access curated data products. This blog explores how RV Tech transforms raw vehicle data into real-time intelligence, supporting use cases across engineering, operations, and customer experience.
Read More
0
0
0
Real Time Airline Operations at Etihad Airways with Data Streaming Using Apache Kafka and Flink
Read More
  • 3.5K views
  • 5 minute read

Etihad Airways Makes Airline Operations Real-Time with Data Streaming

Airlines face constant pressure to deliver reliable service while managing complex operations and rising customer expectations. This blog post explores how Etihad Airways uses real-time data streaming with Apache Kafka and Flink to improve operational efficiency and passenger experience. Based on a presentation at the Data Streaming World Tour in Dubai, it highlights how Etihad built an event-driven platform to move from delayed insights to real-time action. The post also connects this story to other data streaming success cases in the aviation industry, including Lufthansa , Cathay Pacific, Virgin Australia, and Schiphol Airport in Amsterdam.
Read More
0
0
0
Data Streaming Trends for 2026 with Apache Kafka Flink Diskless Cloud Agentic AI
Read More
  • 18.3K views
  • 9 minute read

Top Trends for Data Streaming with Apache Kafka and Flink in 2026

Each year brings new momentum to the data streaming space. In 2026, six key trends stand out. Platforms and vendors are consolidating. Diskless Kafka and Apache Iceberg are reshaping storage. Real-time analytics is moving into the stream. Enterprises demand zero data loss and regional compliance. Streaming is now powering operational AI with real-time context. Data streaming has evolved. It is now strategic infrastructure at the heart of modern enterprise systems.
Read More
0
0
0