Policy Enforcement and Data Quality for Apache Kafka with Schema Registry
Read More

Policy Enforcement and Data Quality for Apache Kafka with Schema Registry

Good data quality is one of the most critical requirements in decoupled architectures, like microservices or data mesh. Apache Kafka became the de facto standard for these architectures. But Kafka is a dumb broker that only stores byte arrays. The Schema Registry enforces message structures. This blog post looks at enhancements to leverage data contracts for policies and rules to enforce good data quality on field-level and advanced use cases like routing malicious messages to a dead letter queue.
Read More
Apache Kafka for Data Consistency (and Real-Time Data Streaming)
Read More

Apache Kafka for Data Consistency (and Real-Time Data Streaming)

Real-time data beats slow data in almost all use cases. But as essential is data consistency across all systems, including non-real-time legacy systems and modern request-response APIs. Apache Kafka’s most underestimated feature is the storage component based on the append-only commit log. It enables loose coupling for domain-driven design with microservices and independent data products in a data mesh. This blog post explores how Kafka enables data consistency with a real-world case study from financial services.
Read More
Decentralized Data Mesh with Data Streaming in Financial Services and Banking
Read More

Decentralized Data Mesh with Data Streaming in Financial Services

Digital transformation requires agility and fast time to market as critical factors for success in any enterprise. The decentralization with a data mesh separates applications and business units into independent domains. Data sharing in real-time with data streaming helps to provide information in the proper context to the correct application at the right time. This blog post explores a case study from the financial services sector where a data mesh was built across countries for loosely coupled data sharing but standardized enterprise-wide data governance.
Read More
Stream Exchange for Data Sharing with Apache Kafka in a Data Mesh
Read More

Streaming Data Exchange with Kafka and a Data Mesh in Motion

Data Mesh is a new architecture paradigm that gets a lot of buzzes these days. This blog post looks into this principle deeper to explore why no single technology is the perfect fit to build a  Data Mesh. Examples show why an open and scalable decentralized real-time platform like Apache Kafka is often the heart of the Data Mesh infrastructure, complemented by many other data platforms to solve business problems.
Read More
Digital Twin with Apache Kafka - Simulating of car manufacturing by robots on Siemens
Read More

Apache Kafka as Digital Twin for Open, Scalable, Reliable Industrial IoT (IIoT)

This blog post discusses the benefits of a Digital Twin in Industrial IoT (IIoT) and its relation to…
Read More
Apache Kafka in the Automotive Industry
Read More

Apache Kafka in the Automotive Industry

In November 2019, I had the pleasure to visit “Motor City” Detroit. I met with several automotive companies,…
Read More
Read More

IoT Live Demo – 100.000 Connected Cars with Kubernetes, Kafka, MQTT, TensorFlow

Live Demo – 100.000 Connected Cars – Real Time Processing and Analytics with Kubernetes, Kafka, MQTT and TensorFlow leveraging Confluent and HiveMQ.
Read More