Apache Kafka + Machine Learning => Confluent Blog Post and Github Project

Posted in Apache Kafka, Big Data, Confluent, Deep Learning, Kafka Streams, KSQL, Machine Learning, Open Source, Stream Processing on October 27th, 2017 by Kai Wähner

I am happy that my first official Confluent blog post was published and want to link to it from by blog:

How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka

The post explains in detail how you can leverage Apache Kafka and its Streams API to deploy analytic models to a lightweight, but scalable, mission-critical streaming appilcation.

Apache Kafka Ecosystem for Machine Learning

Github Examples for Apache Kafka + Machine Learning

If you want to take a look directly at the source code, go to my Github project about Kafka + Machine Learning. It contains several examples how to combine Kafka Streams with frameworks like TensorFlow, H2O or DeepLearning4J.

Tags: , , , , , , , , , , ,

Apache Kafka + Kafka Streams + Mesos / DCOS = Scalable Microservices

Posted in Apache Kafka, Apache Mesos, Big Data, Confluent, Docker, Hadoop, Java / JEE, Kafka Connect, Kafka Streams, KSQL, Kubernetes, Microservices, Open Source on October 27th, 2017 by Kai Wähner

I had a talk at MesosCon 2017 Europe in Prague about building highly scalable, mission-critical microservices with Apache Kafka, Kafka Streams and Apache Mesos / DCOS. I would like to share the slides and a video recording of the live demo.

Abstract

Microservices establish many benefits like agile, flexible development and deployment of business logic. However, a Microservice architecture also creates many new challenges. This includes increased communication between distributed instances, the need for orchestration, new fail-over requirements, and resiliency design patterns.

Tags: , , , , , , , , , , , , , , , , , , , , ,