Browsing Category

Open Source

42 posts
The State of Data Streaming for the Public Sector in 2023
Read More
  • 516 views
  • 5 minute read

The State of Data Streaming for the Public Sector in 2023

This blog post explores the state of data streaming for the public sector and government in 2023. Data streaming provides consistency across all layers and allows integrating and correlating data in real-time at any scale. I look at public sector trends to explore how Apache Kafka helps as a business enabler, including case studies from the US Department of Defense (DoD), NASA, Deutsche Bahn (German Railway), and others. A complete slide deck and on-demand video recording are included.
Read More
0
0
0
Apache Kafka and Apache Flink for Open Source and Cloud-native Data Streaming
Read More
  • 3.3K views
  • 12 minute read

Apache Kafka (including Kafka Streams) + Apache Flink = Match Made in Heaven

Apache Kafka and Apache Flink are increasingly joining forces to build innovative real-time stream processing applications. This blog post explores the benefits of combining both open-source frameworks, shows unique differentiators of Flink versus Kafka, and discusses when to use a Kafka-native streaming engine like Kafka Streams instead of Flink.
Read More
1
0
0
Data Streaming Landscape 2023 with Apache Kafka Flink and much more
Read More
  • 1.8K views
  • 13 minute read

The Data Streaming Landscape 2023

Data streaming is a new software category to process data in motion. Apache Kafka is the de facto standard used by over 100,000 organizations. Plenty of vendors offer Kafka platforms and cloud services. Many complementary stream processing engines like Apache Flink and SaaS offerings have emerged. And competitive technologies like Pulsar and Redpanda try to get market share. This blog post explores the data streaming landscape of 2023 to summarize existing solutions and market trends.
Read More
1
0
0
Cloud Native SCADA Industrial IoT with Apache Kafka Data Streaming
Read More
  • 1.2K views
  • 6 minute read

A cloud-native SCADA System for Industrial IoT built with Apache Kafka

Industrial IoT and Industry 4.0 enable digitalization and innovation. SCADA control systems are a vital component of IT/OT modernization. The SCADA evolution started with monolithic applications and moved to networked and web-based platforms. This blog post explores building the 5th generation: A cloud-native SCADA infrastructure with Apache Kafka. A real-world case study explores the journey of a German system operator for electricity to show how such a journey to open and scalable real-time workloads and edge-to-cloud integration progressed.
Read More
0
0
0
Kafka versus HTTP REST API
Read More
  • 2.3K views
  • 11 minute read

Request-Response with REST/HTTP vs. Data Streaming with Apache Kafka – Friends, Enemies, Frenemies?

Request-response communication with REST / HTTP is simple, well understood, and supported by most technologies, products, and SaaS cloud services. Contrarily, data streaming with Apache Kafka is a fundamental change to process data continuously. HTTP and Kafka complement each other in various ways. This post explores the architectures and use cases to leverage request-response together with data streaming in the control plane for management or in the data plane for producing and consuming events.
Read More
0
0
0
Cloud Native Core Banking Platform powered by Apache Kafka Data Streaming
Read More
  • 994 views
  • 10 minute read

Cloud-native Core Banking Modernization with Apache Kafka

Most financial service institutions operate their core banking platform on legacy mainframe technologies. The monolithic, proprietary, inflexible architecture creates many challenges for innovation and cost-efficiency. This blog post explores three open, elastic, and scalable banking solutions powered by Apache Kafka to solve these problems.
Read More
0
0
0
Apache Kafka Transactions API vs Big Data Lake and Batch Analytics
Read More
  • 1.6K views
  • 9 minute read

Analytics vs. Transactions in Data Streaming with Apache Kafka

Workloads for analytics and transactions have very unlike characteristics and requirements. Many people think that Apache Kafka is not built for transactions and should only be used for big data analytics. This blog post explores when and how to use Kafka in resilient, mission-critical architectures and when to use the built-in Transaction API.
Read More
0
0
0
Apache Camel vs Apache Kafka Comparison
Read More
  • 4.1K views
  • 13 minute read

When to use Apache Camel vs. Apache Kafka?

Should I use Apache Camel or Apache Kafka for my next integration project? The question is very valid and comes up regularly. This blog post explores both open-source frameworks and explains the difference between application integration and event streaming. The comparison discusses when to use Kafka or Camel, when to combine them, when not to use them at all. A decision tree shows how you can quickly qualify out one for the other.
Read More
1
0
2
Apache Kafka for Government and Citizen Services in the Public Sector
Read More
  • 770 views
  • 5 minute read

Apache Kafka in the Public Sector – Part 3: Government and Citizen Services

The public sector includes many different areas. Some groups leverage cutting-edge technology, like military leverage. Others like the public administration are years or even decades behind. This blog series explores both edges to show how data in motion powered by Apache Kafka adds value for innovative new applications and modernizing legacy IT infrastructures. This is part 3: Use cases and architectures for Government and Citizen Services.
Read More
0
0
0
Apache Kafka in the Insurance Industry
Read More
  • 1.7K views
  • 7 minute read

Apache Kafka in the Insurance Industry

The rise of data in motion in the insurance industry is visible across all lines of business including life, healthcare, travel, vehicle, and others. Apache Kafka changes how enterprises rethink data. This blog post explores use cases and architectures for insurance-related event streaming. Real-world examples from Generali, Centene, Humana, and Tesla show innovative data integration and stream processing in real-time.  
Read More
1
0
0