Java Archives - Kai Waehner

Apache Kafka and PLC4X Architecture for IIoT Automation Industry

464 views
6 minute read

Apache Kafka, KSQL and Apache PLC4X for IIoT Data Integration and Processing

ByKai Waehner
2. September 2019

Data integration and processing in Industrial IoT (IIoT, aka Industry 4.0 or Automation Industry). Apache Kafka, its ecosystem (Kafka Connect, KSQL) and Apache PLC4X are a great open source choice to implement this integration end to end in a scalable, reliable and flexible way.

ByKai Waehner
9. July 2018

Machine Learning / Deep Learning models can be used in different ways to do predictions. Natively in the application or hosted in a remote model server. Then you combine stream processing with RPC / Request-Response paradigm. This blog post shows examples of stream processing vs. RPC model serving using Java, Apache Kafka, Kafka Streams, gRPC and TensorFlow Serving.

ByKai Waehner
13. March 2018

I spoke at Voxxed Zurich 2018 about Apache Kafka as Event-Driven Open Source Streaming Platform. The talk includes…

ByKai Waehner
27. October 2017

I am happy that my first official Confluent blog post was published and want to link to it from by blog: How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka

ByKai Waehner
4. October 2017

Apache Kafka + Kafka Streams to Produductionize Neural Networks (Deep Learning). Models built with TensorFlow, DeepLearning4J, H2O. Slides from JavaOne 2017.

ByKai Waehner
24. February 2017

Case Study: How to Move from a (Middleware) Monolith to Cloud, Containers and Microservices leveraging Docker, Cloud Foundry, Kubernetes, Consul, Hystrix, API Management, and others cool things.

ByKai Waehner
3. November 2016

Comparison of Open Source IoT Integration Frameworks such as Eclipse Kura (+ Apache Camel), Node-RED, Flogo, Apache Nifi, StreamSets, and others… (slide and video recording)

ByKai Waehner
3. November 2016

Introduction to the Open Source IoT Integration Project Flogo to build very lightweight edge applications and microservices for cloud native containers / cloud platforms / serverless architectures.

ByKai Waehner
23. September 2016

JavaOne 2016 Trends: Besides focus on Java platform updates (Java 9, Java EE 8, etc.), I saw three hot topics, which are highly related to each other: Microservices, Docker and Cloud. I also talked about this topic from a middleware perspective. See my slides and lessons learned.

ByKai Waehner
5. August 2016

This article shows the different components available for a Hybrid Integration Architecture. The goal is not to discuss different vendor offerings but to explain different concepts and benefits of each component in general and how they relate to each other. Including concepts such as Hybrid Integration Platform (HIP), Cloud-Native Middleware, PaaS, Docker, iPaaS, iSaaS, API Management, and others.

Technology Evangelist for Confluent

Kai Waehner

Java

Video Recording – Apache Kafka as Event-Driven Open Source Streaming Platform (Voxxed Zurich 2018)

Apache Kafka + Machine Learning => Confluent Blog Post and Github Project

Deep Learning in Real Time with TensorFlow, H2O.ai and Kafka Streams (Slides from JavaOne 2017)

Technology Evangelist for Confluent

Kai Waehner

Apache Kafka vs. Middleware (MQ, ETL, ESB) – Slides + Video

Deep Learning Example: Apache Kafka + Python + Keras + TensorFlow + Deeplearning4j

Apache Kafka and Machine Learning for Real Time Supply Chain Optimization in IIoT