IoT Integration with Kafka Connect, REST / HTTP, MQTT, OPC-UA – Lightboard Video

Posted in Apache Kafka, Big Data, Cloud, Confluent, EAI, ESB, IIoT, Integration, Internet of Things, Kafka Connect, Kafka Streams, KSQL, Messaging, Middleware, MQTT, Open Source, PLC4X, Stream Processing on July 26th, 2019 by admin

I just want to share my lightboard video recording. I talk about IoT integration and processing with Apache Kafka using Kafka Connect, Kafka Streams, KSQL, REST / HTTP,  MQTT and OPC-UA. Use cases, alternative architectures and different integration options are discussed on whiteboard.

End-to-End IoT Integration from Edge to Confluent Cloud

In this lightboard, Confluent’s Kai Waehner (Technology Evangelist) and Konstantin Karantasis (Software Engineer) discuss use cases leveraging the Apache Kafka open source ecosystem as a streaming platform to process IoT data. The session shows architectural alternatives of how devices like cars, machines or mobile devices connect to Apache Kafka via IoT standards like MQTT or OPC-UA.

Tags: , , , , , , , , , , , , , , , , , , , , ,

Apache Kafka vs. Middleware (MQ, ETL, ESB) – Slides + Video

Posted in Apache Kafka, Big Data, Confluent, EAI, ESB, In Memory, Integration, Kafka Connect, Kafka Streams, KSQL, Messaging, Microservices, Middleware, Open Source, SOA, Stream Processing on March 7th, 2019 by Kai Wähner

Learn the differences between an event-driven streaming platform like Apache Kafka and middleware like Message Queues (MQ), Extract-Transform-Load (ETL) and Enterprise Service Bus (ESB). Including best practices and anti-patterns, but also how these concepts and tools complement each other in an enterprise architecture.

This blog post shares my slide deck and video recording. I discuss the differences between Apache Kafka as Event Streaming Platform and integration middleware. Learn if they are friends, enemies or frenemies.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Apache Kafka vs. ESB / ETL / MQ

Posted in Apache Kafka, Big Data, Confluent, EAI, ESB, Integration, Kafka Connect, Kafka Streams, KSQL, Messaging, Microservices, Middleware, Open Source, SOA, Stream Processing on July 18th, 2018 by Kai Wähner

Apache Kafka and Enterprise Service Bus (ESB) are complementary, not competitive!

Apache Kafka is much more than messaging in the meantime. It evolved to a streaming platform including Kafka Connect, Kafka Streams, KSQL and many other open source components. Kafka leverages events as a core principle. You think in data flows of events and process the data while it is in motion. Many concepts, such as event sourcing, or design patterns such as Enterprise Integration Patterns (EIPs), are based on event-driven architecture.

Tags: , , , , , , , , , , , , , , , , ,

Agile Cloud-to-Cloud Integration with iPaaS, API Management and Blockchain

Posted in API Management, Blockchain, Cloud, Cloud-Native, Docker, EAI, ESB, Microservices, Middleware on April 23rd, 2017 by Kai Wähner

Cloud-to-Cloud integration is part of a hybrid integration architecture. It enables to implement quick and agile integration scenarios without the burden of setting up complex VM- or container-based infrastructures. One key use case for cloud-to-cloud integration is innovation using a fail-fast methodology where you realize new ideas quickly. You typically think in days or weeks, not in months. If an idea fails, you throw it away and start another new idea. If the idea works well, you scale it out and bring it into production to a on premise, cloud or hybrid infrastructure. Finally, you make expose the idea and make it easily available to any interested service consumer in your enterprise, partners or public end users.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Case Study: From a Monolith to Cloud, Containers, Microservices

Posted in API Management, Cloud, Cloud-Native, Docker, EAI, ESB, Java / JEE, Microservices, Middleware, SOA on February 24th, 2017 by Kai Wähner

The following shows a case study about successfully moving from a very complex monolith system to a cloud-native architecture. The architecture leverages containers and Microservices. This solve issues such as high efforts for extending the system, and a very slow deployment process. The old system included a few huge Java applications and a complex integration middleware deployment.

The new architecture allows flexible development, deployment and operations of business and integration services. Besides, it is vendor-agnostic so that you can leverage on-premise hardware, different public cloud infrastructures, and cloud-native PaaS platforms.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , ,

Trends at JavaOne 2016: Microservices, Docker, Cloud-Native Middleware

Posted in Cloud, Cloud-Native, Docker, ESB, Java / JEE, Microservices, Middleware, SOA on September 23rd, 2016 by Kai Wähner

Like every year, I attended JavaOne (part of Oracle World) in San Francisco in late September 2016. This is still one of the biggest conferences around the world for technical experts like developers and architects.

I planned to write a blog posts about new trends from the program, exhibition and chats with other attendees. Though, I can make it short: Besides focus on Java platform updates (Java 9, Java EE 8, etc.), I saw three hot topics which are highly related to each other: Microservices, Docker and Cloud. It felt like 80% of non-Java talks were about these three topics. The other 20% were Internet of Things (IoT), DevOps and some other stuff. Middleware was also a hot topic. Not always directly, but I was in several talks focusing on integration, orchestration of microservices, (IoT) gateways.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Why TIBCO ActiveMatrix BusinessWorks 6 Is a Leading Integration and Service Delivery Platform

Posted in EAI, ESB, Microservices, Middleware, SOA on July 8th, 2016 by Kai Wähner

TIBCO ActiveMatrix BusinessWorks 6 is a modern integration and service delivery platform ready for modern concepts such Mobile, Cloud, Internet of Things or Microservices. This article is no introduction to integration and service delivery platforms in general, but focuses on differentiators of BusinessWorks 6 compared to other integration solutions available on the market. If you want to see a general introduction to TIBCO ActiveMatrix BusinessWorks 6, explaining its basic concepts and capabilities such as:

  • zero-coding process designer for quick implementation, testing, and maintenance
  • distributed scalability for mission-critical systems and ultra-high performance
  • standards-based service and application integration
Tags: , , , , , , , , , , , , , , , , , , , , , , , ,

Comparison: TIBCO ActiveMatrix BusinessWorks 6 / Container Edition vs. BW5

Posted in API Management, Cloud, Docker, ESB, Microservices, SOA on April 6th, 2016 by Kai Wähner

[This article was posted some time ago on the TIBCO Blog, already. I also added some information about BusinessWorks Container Edition (BW CE) where appropriate. Most of the characteristics defined below are true for both, BW6 and BW CE]

TIBCO ActiveMatrix BusinessWorks 6 (BW6) is a modern integration and service delivery platform ready for modern concepts such Mobile, Cloud, Internet of Things or Microservices. This article is no introduction to integration and service delivery platforms in general, but focuses on differentiators of BusinessWorks 6 compared to other integration solutions available on the market. If you want to see a general introduction to TIBCO ActiveMatrix BusinessWorks 6, explaining its basic concepts and capabilities such as:

Tags: , , , , , , , , , , , , , , , , , , ,

Microservices = Death of the ESB? (2016, Meetup Dublin)

Posted in API Management, Big Data, Cloud, Docker, EAI, ESB, IT Conferences, Microservices, SOA on January 29th, 2016 by Kai Wähner

I was invited to speak at Microservices Meetup Dublin this week. I updated my slide deck “Microservices – Death of the ESB?” … The meetup was fully booked with a waiting list; around 120 attendees came to Gild‘s office. (see attached link).

If you have not seen the slide deck last year, you should definitely take a look at this updated version with more recent information. I also incorporated valuable information from discussions with attendees in 2015’s sessions about this topic.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Docker Containers in the Middleware Universe

Posted in Cloud, Docker, EAI, ESB, Microservices, SOA on September 7th, 2015 by Kai Wähner

Docker is one of the hottest technologies right now.

Relation to SOA, ESB and Microservices

Many TIBCO customers already ask how they can leverage Docker in combination with SOA, ESB and Microservices, and what TIBCO’s strategy is. I just want to refer to an article I published recently, it shows some insights about TIBCO’s future strategy from the Docker perspective:

Docker Containers in the TIBCO Universe

The following shows a snippet of the article, which explains how Docker is related to Microservices.

Tags: , , , , , , , , , , , ,