IoT Integration with Kafka Connect, REST / HTTP, MQTT, OPC-UA – Lightboard Video
Kai Waehner
I just want to share my lightboard video recording. I talk about IoT integration and processing with Apache…
Browsing Category
Stream Processing
47 posts
Apache Kafka vs. Middleware (MQ, ETL, ESB) – Slides + Video
This post shares a slide deck and video recording of the differences between an event-driven streaming platform like Apache Kafka and middleware like Message Queues (MQ), Extract-Transform-Load (ETL) and Enterprise Service Bus (ESB).
Apache Kafka + KSQL + TensorFlow for Data Scientists via Python + Jupyter Notebook
Streaming Processing with Apache Kafka and KSQL for Data Scientists via Python and Jupyter Notebooks to build analytic models with TensorFlow and Keras.
Deep Learning Example: Apache Kafka + Python + Keras + TensorFlow + Deeplearning4j
“Python + Keras + TensorFlow + DeepLearning4j + Apache Kafka + Kafka Streams” => New example added to my “Machine Learning + Kafka Streams Examples” Github project.
Apache Kafka + MQTT = End-to-End IoT Integration (Code, Slides, Video)
MQTT and Apache Kafka are a perfect combination for end-to-end IoT integration from edge to data center. This post discusses two different approaches and refers to implementations on Github using Apache Kafka, Kafka Connect, Confluent MQTT Proxy and Mosquitto.
Apache Kafka vs. ESB / ETL / MQ
Read why enterprises leverage the open source ecosystem of Apache Kafka for successful integration of different legacy and modern applications instead of ESB, ETL or MQ.
Model Serving: Stream Processing vs. RPC / REST with Java, gRPC, Apache Kafka, TensorFlow
Machine Learning / Deep Learning models can be used in different ways to do predictions. Natively in the application or hosted in a remote model server. Then you combine stream processing with RPC / Request-Response paradigm. This blog post shows examples of stream processing vs. RPC model serving using Java, Apache Kafka, Kafka Streams, gRPC and TensorFlow Serving.
Apache Kafka + KSQL Live Demo (Video Recording) using CSV, JSON, Apache Avro
Apache Kafka + KSQL Live Demo using CSV, JSON, Apache Avro. 10min live demo to get introduced to KSQL – the streaming SQL engine for Apache Kafka. Write and deploy SQL queries for stream processing instead of source code.
KSQL Deep Dive – The Open Source Streaming SQL Engine for Apache Kafka
KSQL is the open source, Apache 2.0 licensed streaming SQL engine on top of Apache Kafka. This post shows a deep dive (slides + video recording) including its relation to Kafka Connect and Kafka Streams, concepts, architecture and deployment options.
Rethinking Stream Processing with Apache Kafka, Kafka Streams and KSQL
I presented at JavaLand 2018 in Brühl recently. A great developer conference with over 1800 attendees. The location…
