Enterprise Integration Patterns (EIP) Revisited in 2014

Posted in EAI, ESB, SOA on July 17th, 2014 by Kai Wähner

Today, I had a talk about “Enterprise Integration Patterns (EIP) Revisited in 2014″ at Java Forum Stuttgart 2014, a great conference for developers and architects with 1600 attendees.

Enterprise Integration Patterns

Data exchanges between companies increase a lot. Hence, the number of applications which must be integrated increases, too. The emergence of service-oriented architectures and cloud computing boost this even more. The realization of these integration scenarios is a complex and time-consuming task because different applications and services do not use the same concepts, interfaces, data formats and technologies.

Tags: , , , , , , , , , , , , , ,

“Hadoop and Data Warehouse (DWH) – Friends, Enemies or Profiteers? What about Real Time?” – Slides (including TIBCO Examples) from JAX 2014 Online

Posted in Analytics, Big Data, Business Intelligence, Cloud, ESB, Hadoop on May 13th, 2014 by Kai Wähner

Slides from my talk “Hadoop and Data Warehouse (DWH) – Friends, Enemies or Profiteers? What about Real Time?” at JAX 2014 (Twitter #jaxcon) in Mainz are online. JAX is a great conference with interesting topics and many good speakers!

Content (Data Warehouse, Business Intelligence, Hadoop, Stream Processing)

Big data represents a significant paradigm shift in enterprise technology. Big data radically changes the nature of the data management profession as it introduces new concerns about the volume, velocity and variety of corporate data. New business models based on predictive analytics, such as recommendation systems or fraud detection, are relevant more than ever before. Apache Hadoop seems to become the de facto standard for implementing big data solutions. For that reason, solutions from many different vendors emerged on top of Hadoop.

Tags: , , , , , , , , , , , , , , , , , , , , , , , ,

Realtime Event Logging, Complex Event Processing (CEP) and Monitoring with Talend’s Unified Platform 5.4 (DI, ESB, DQ, MDM, BPM) using ElasticSearch, Logstash and Kibana

Posted in EAI, ESB on December 17th, 2013 by Kai Wähner

Your mission-critical projects need complex event processing, realtime management and monitoring. Talend 5.4 (released in December 2014, https://www.talend.com) offers a great new feature: Talend Event Logging. It allows logging, processing and monitoring of all technical events and business data. In this article, I will focus on how to process, filter and monitor business data. You can find more details about monitoring technical events and logs (e.g. OSGi events of the ESB container) in Talend’s documentation (www.help.talend.com). This new feature is very powerful, but also extendable to fit custom requirements. You can solve and monitor much more complex scenarios than the one I describe here.

Slides online: “Enterprise Integration Patterns Revisited” – Talk at OBJEKTspektrum Information Days 2013

Posted in EAI, ESB on November 19th, 2013 by Kai Wähner

I had a brand new talk at OBJEKTspektrum Information Days 2013 in Frankfurt and Munich this week: Enterprise Integration Patterns Revisited. I wanna share my slides with you.

Content

Applications have to be integrated – no matter which programming languages, databases or infrastructures are used. However, the realization of integration scenarios is a complex and time-consuming task. Over 10 years ago, Enteprise Integration Patterns (EIP) became the world wide defacto standard for splitting huge, complex integration scenarios into smaller recurring problems. These patterns appear in almost every integration project.
This session revisits EIPs and gives shows status quo. After giving a short introduction with several examples, the audience will learn which EIPs still have a „right to exist“, and which new EIPs emerged in the meantime. The end of the session shows different frameworks and tools which already implement EIPs and therefore help the architect to reduce efforts a lot.

Slides

Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB) from Kai Waehner
Tags: , , , , , , , ,

JBoss OneDayTalk 2013: “NoSQL Integration with Apache Camel – MongoDB, CouchDB, Neo4j, Cassandra, HBase, Hazelcast, Riak, etc.”

Posted in EAI, ESB, Java / JEE on October 24th, 2013 by Kai Wähner

JBoss OneDayTalk is a great annual event around open source development. I have done a talk about “NoSQL Integration with Apache Camel”. This blog post shows you the updated slide deck of this talk.

Abstract

SQL cannot solve several problems emerging with big data. A distributed, fault-tolerant architecture is necessary. NoSQL comes to the rescue, but therefore it does not use SQL as its query language or give full ACID guarantees. Thus, in the future you will have to learn new concepts and integrate these NoSQL databases as you integrate SQL databasestoday. The open source integration framework Apache Camel is already prepared for this challenging task.

Tags: , , , , , , , ,

How to choose the right Open Source Integration Framework – Apache Camel (JBoss, Talend), Spring Integration (Pivotal) or Mule ESB? – JavaOne 2013

Posted in EAI, ESB on September 25th, 2013 by Kai Wähner

Slides from my talk “How to choose the right Integration Framework” at JavaOne 2013, San Francisco, are online.

Abstract

Data exchanges between companies increase a lot. The number of applications which must be integrated increases, too. The interfaces use different technologies, protocols and data formats. Nevertheless, the integration of these applications shall be modeled in a standardized way, realized efficiently and supported by automatic tests.

Three integration frameworks are available in the JVM environment, which fulfil these requirements: Apache Camel, Spring Integration and Mule. They implement the well-known Enteprise Integration Patterns (EIP) and therefore offers a standardized, domain-specific language to integrate applications.

Tags: , , , , , , , , , , , , , , , ,

Apache Camel and Talend ESB: Management and Monitoring of Integration Routes and SOAP / REST Web Services (JMX, OSGi, logstash, ElasticSearch, Kibana, hawtio)

Posted in ESB on July 15th, 2013 by Kai Wähner

A question every customer asks me: How can you manage and monitor integration routes implemented with Apache Camel (http://camel.apache.org/) and / or Talend ESB (http://en.talend.com/products/esb) (which is based on Apache Camel and also available as open source version). This blog post will show different alternatives to answer this question. The good news first: As Apache Camel and Talend ESB are based on open standards, you can use your own frameworks and tools if tooling of the product is not sufficient. So, I will not talk just about features of Apache Camel or Talend ESB, but also about additional options. Except for Talend Administration Center (user interface on top of Talend ESB’s service monitoring and clustering features), all tools are open source. Talend Administration Center is only available in Talend’s enterprise editions.

Tags: , , , , , , , , , , , , , , , , , , , ,

Integration of Amazon Redshift Cloud Data Warehouse (AWS SaaS DWH) with Talend Data Integration (DI) / Big Data (BD) / Enterprise Service Bus (ESB)

Posted in Cloud, EAI, ESB on June 26th, 2013 by Kai Wähner

In this blog post, I will show you how to „ETL“ all kinds of data to Amazon’s cloud data warehouse Redshift wit Talend’s big data components. Let’s begin with a short introduction to Amazon Redshift (copied from website):

„Amazon Redshift is [part of Amazon Web Services (AWS) and] a fast and powerful, fully managed, petabyte-scale data warehouse service in the cloud. With a few clicks in the AWS Management Console, customers can launch a Redshift cluster, starting with a few hundred gigabytes and scaling to a petabyte or more, for under $1,000 per terabyte per year.
Traditional data warehouses require significant time and resource to administer, especially for large datasets. In addition, the financial cost associated with building, maintaining, and growing self-managed, on-premise data warehouses is very high. Amazon Redshift not only significantly lowers the cost of a data warehouse, but also makes it easy to analyze large amounts of data very quickly.“

Tags: , , , , , , , , , , , , , ,

SAP Integration with Talend Components / Connectors (BAPI, RFC, IDoc, BW, SOAP)

Posted in EAI, ESB on March 3rd, 2013 by Kai Wähner

Talend has several connectors to integrate SAP systems. However, this guide is no introduction to Talend’s SAP components. Instead, this guide helps to

  • understand different alternatives to integrate SAP systems with Talend
  • set up a local SAP system
  • configure Talend Studio for using SAP components
  • use Talend’s SAP wizard
  • run a first Talend Job which connects to SAP

All further required information and example use cases for Talend’s SAP components should be available in the Talend component guide at www.help.talend.com. If that’s not the case, please create a JIRA Documentation ticket (https://jira.talendforge.org/browse/DOCT)!
Now let’s take a look at different alternatives for integration of SAP systems with Talend.

Tags: , , , ,

Spoilt for Choice: How to Choose the Right Enterprise Service Bus (ESB)?

Posted in BPM, EAI, ESB, SOA on January 23rd, 2013 by Kai Wähner

I had a very interesting talk at OOP 2013 in Germany. OOP is a great conference for software architects and decision makers. The topic of my talk was “Spoilt for Choice: How to Choose the Right Enterprise Service Bus (ESB)”. Hereby, I want to share the slides with you…

Tags: , , , , , , , , , , , , , , ,