Latest Insights on: Data Integration, Process Intelligence, Agentic AI, and Enterprise Architecture
Latest Insights: Data Integration | Process Intelligence | Trusted Agentic AI | Enterprise Architecture
Kai Waehner is a Global Field CTO writing about data integration, workflow orchestration, process intelligence, trusted agentic AI, and enterprise architecture. Articles cover real customer use cases across industries, from data streaming with Apache Kafka and Flink to workflow automation, process mining, and governed AI agents. Posts look at architecture patterns and vendor trade-offs across the market, not a single product.
All
5G
6G
A2A
Adapter
Advertising Platform
Aftermarket
Aftersales
Agentic AI
AI
Air Gapped
Airline
Airlines
Airport
Aiven
Akka
Alibaba
Allgemein
Amazon MSK
Analytics
Apache Camel
Apache Flink
Apache Iceberg
Apache Kafka
Apache Mesos
Apache Pulsar
Apache Spark
API
API Gateway
API Management
Application Server
Architecture
Ariba
ARM
Artificial Intelligence
Asset Tracking
Audio
Augmented Reality
Automation Industry
Automotive
AutoMQ
Autonomous Networks
Aviation
AWS
AWS Outposts
AWS Wavelength
Azure
Azure Event Hubs
B2B
Banking
BAPI
Batch Processing
Betting
Big Data
BigQuery
Biotech
Biotechnology
Bitcoin
Blockchain
Book
Bookmaker
BPM
Bring Your Own Cloud
BSS
Buf
Business Intelligence
Business Value
BYOC
Career
Case Study
CEP
Change Data Capture
Chatbot
ChatGPT
ChatGTP
CIO
Citizen
Claim Processing
ClickHouse
Cloud
Cloud-Native
Cloudera
Company
Comparison
Complex Event Processing
Compliance
Concur
Condition Monitoring
Conduktor
Conference
Confluent
Confluent Cloud
Connected Cars
Connected Vehicles
Context Engine
Control Tower
Conversational AI
Core Banking
CRM
Crypto
Cryptocurrency
Customer
Customer 360
Cybersecurity
Data at Rest
Data Catalog
Data Consistency
Data Contract
Data Engineering
Data Fabric
Data Governance
Data Historian
Data Hub
Data in Motion
Data Integration
Data Lake
Data Lineage
Data Mesh
Data Product
Data Quality
Data Science
Data Sharing
Data Streaming
Data Warehouse
database
Databricks
DB2
dbt
Dead Letter Queue
Deep Learning
DeFi
Design Pattern
Digital Forensics
Digital Natives
Digital Twin
Disaster Recovery
Diskless Kafka
Distributed Ledger
Docker
Domain Driven Design
Durable Execution Engine
Dynamic Pricing
EAI
Eclipse Kura
eCommerce
Edge
Edge Computing
EIPaaS
Elasticsearch
Electric Vehicle
ELT
Energy
Energy Trading
Enterprise
Enterprise AI
Enterprise Architecture
EOS
ERP
ESB
ESG
eSports
Ethereum
ETL
Event Streaming
Event-Driven Architecture
Exactly once semantics
Fantasy Sports
Featured Posts
Field CTO
Finance Industry
Financial Services
FinOps
FinTech
Fleet Management
FlinkSQL
Food
Forensics
Forrester
Fraud
Fraud Detection
Fraud Prevention
Gambling
Games
Gaming
GCP
GDS
GenAI
Google
Government
Grepp Labs
Hadoop
Healthcare
Hivecell
Hon Circle
HTTP
Hybrid Cloud
Hyperledger
IBM
IBM MQ
iDoc
IIoT
In Memory
Industrial IoT
Industry 4.0
Innovation
Insurance
Insurance Industry
Integration
Internet
Internet of Things
Intrusion Detection
Inventory Management
IOTA
iPaaS
IT Certifications
IT Conferences
IT Modernization
Java / JEE
JavaScript
JMS
Job Profile
Job Role
Jupyter
Kafka
Kafka Connect
Kafka Streams
Kappa Architecture
Kestra
Kroxyliciou
KSQL
ksqlDB
Kubernetes
Lake House
Lakehouse
Lambda Architecture
Landscape
LangChain
Large Language Model
Large Messages
Legacy
Libra
Life Science
Live Commerce
Load Balancing
Logistics
Low-Code No-Code
Loyalty Platform
Lufthansa
Machine Learning
Machine Vision
Madrid
Mainframe
Manufacturing
Marketing
Marketplace
MCP
Media
Message Broker
Message Queue
Messaging
Metaverse
Microservices
Microsoft Fabric
Middleware
Miles & More
Military
Mining
mission-critical
Mobility Services
Model Drift
Model Training
MQTT
MVNO
MWC
National Security
NFT
NLP
NodeJS
NoSQL
Object Storage
Observability
OEM
Oil and Gas
Omnichannel
OPC UA
OPC-UA
Open API
Open Banking
Open RAN
Open Source
OpenAI
OpenLineage
Oracle
Orchestration
OSIsoft PI
OSS
OT/IT
OTT (Over the Top)
Paimon
Payment
Persistence
Pharma
PLC4X
Predictive Maintenance
Process Intelligence
Product Management
Proxy
Public Sector
Python
QCon
Qualitrics
Queues for Kafka
RabbitMQ
Ransomware
Real Time
Real Time Locating System
Recommendation
Red Hat
Redpanda
REST
Retail
Retail Media
Retention
Retrieval Augmentation Generation
Reverse ETL
Ripple
Routing
RPA
RTLS
S3
SaaS
Sales
Sales and Marketing
Salesforce
SAP
SAP Datasphere
SAP Hana
SAP Sapphire
SCADA
Schema Registry
SCM
Security
Serverless
Service
Service Mesh
ServiceNow
Shift Left Architecture
Shipping
Shop Floor
SIEM
Situational Awareness
SLA
Smart Building
Smart City
Smart Factory
Smart Grid
Snowflake
SOA
SOAP
SOAR
Social Commerce
Social Network
Software
Software Company
Software Development
Solace
Sparkplug
Splunk
Sports
SQL
Stablecoins
Starlink
Stream Processing
Streaming Analytics
Streaming Database
Subscription Commerce
Success Stories
Supply Chain
Supply Chain Attack
Table Format
Tableflow
Telco
Telecom
Telecommunications Industry
TensorFlow
Threat Detection
Threat Intelligence
Tiered Storage
Tinybird
Track and Trace
transaction
Transactions
Transportation
Trends
UFC
Uncategorized
Unified Namespace
Use Cases
Utilities
V2X
Vector Database
Ververica
Video
Video Streaming
VIP
Virtual Power Plant
Virtual Reality
Visual Coding
WarpStream
Web Framework
Web Service
Web3
Workflow
Workflow Orchestration
WSDL
XML
Zero ETL
Zero Trust
13. November 2026The source of truth for AI agents is a combination of systems in an event-driven architecture. The database is the system of record, where every transaction happens. Apache Kafka is the way in and out: events, a real-time view of the…
10. November 2026Five vendors with five strategies chose the same database underneath. What the Neon and Crunchy Data deals tell you, where Postgres reaches its limits, and why Oracle, SAP, IBM, and OceanBase build the same capabilities into their own…
6. November 2026Airlines run data pipelines, infrastructure automation, application workflows and business processes in separate orchestration silos, each with its own scheduler and audit trail. Unified orchestration in aviation puts them under one…
3. November 2026AI agents pile up debt when retries, approvals and audit land in the wrong layer. A guide from model and harness to durable execution and the control plane, with a worked invoice dispute….
1. November 2026My Lufthansa HON Circle experience in 2026 as a frequent flyer with around 30 trips a year. The new HON service, First Class upgrades and lounges worldwide work well. Boarding groups, feeder flights from Nuremberg and the group’s IT…
27. October 2026Humanoids get the headlines, but most physical AI value comes from what happens after a machine detects something: quality holds, work orders and approvals across MES, ERP and asset management….
20. October 2026Within a month of Jev by TypeSafe AI, hyperscalers, AI labs, data platforms and open source projects shipped their own decision models. The request schema became the standard, the model became interchangeable, and benchmark claims…
15. October 2026Kafka moves the events, but nothing coordinates what happens next. This post shows how Kestra runs on the Kafka cluster you already operate, turns topics into workflow triggers that reach ServiceNow and RabbitMQ, and where Flink or…
12. October 2026The Industrial IoT Landscape Q4 2026 maps vendors and open source from edge to cloud in four categories, explains the Unified Namespace shift, and shows where OT meets enterprise IT….
6. October 2026Telecom has more orchestration standards than any other industry, and the maturity stops at the network boundary. This post maps unified orchestration to the operator: the four silos, the tools in each, the billing cycle, copper…
1. October 2026Jev by TypeSafe AI returns a calibrated probability instead of text. In a workflow that becomes a confidence gate: high confidence proceeds, medium goes to an LLM, low goes to a person, and every decision lands in a log. This post…
30. September 2026Jev by TypeSafe AI returns typed decisions with calibrated probabilities in a few hundred milliseconds. This post shows how a System One model fits per-event decisions on Apache Kafka and Flink, how Flink prepares the state, how…
28. September 2026System One models such as Jev by TypeSafe AI answer typed questions with calibrated probabilities in a few hundred milliseconds instead of generating text. This post explains how they compare with rules, trained machine learning and…
24. September 2026A working Python cron job moved to Kestra, the open source workflow orchestration platform, without a rewrite. Wrapping it unchanged surfaced a bug that had cost forty-five minutes every morning for weeks, and a later incident showed…
21. September 2026The Q3 2026 edition of the data streaming trends names ten trends through 2027, grouped by market, architecture, and practice: consolidation and migration tooling, sovereignty, diverging Kafka implementations, diskless Kafka, the…
15. September 2026Banks run four disconnected orchestration silos: data pipelines, batch schedulers, application workflows, and business processes, held together by homegrown glue code. With T+1 settlement, instant payments, and DORA enforcement…
9. September 2026Kestra is the open source platform for unified orchestration: one control plane for data, infrastructure, applications, and business processes, with AI agents governed across all four. This article explains what unified orchestration…
7. September 2026The Data Streaming Landscape Q3 2026 maps every major streaming vendor and open-source project by workload and operating model, explains why data sovereignty now shapes deployment, and covers Confluent inside IBM and the lakehouse…
1. September 2026An AI agent harness is everything between the model API and the business outcome. Models became swappable, so vendor lock-in moved into the harness: context, definitions, and runtime. This post gives enterprise buyers the portability…
28. August 2026Factories do not lack automation. They lack coordination between automations. This post maps unified orchestration to manufacturing and logistics: data pipelines from OPC UA and MQTT to the lakehouse, Python orchestrators like Airflow,…
24. August 2026Confluent rearchitected Control Center away from its Kafka Streams metrics pipeline. Kestra 2.0 rebuilt its queuing layer around plain queueing. Two companies that know streaming as well as anyone reached the same conclusion about the…
21. August 2026Every vendor now sells an AI database. This deep dive compares OceanBase with Databricks and Snowflake across transactions, analytics, and AI agents, including when not to use each….
17. August 2026Every router can pick a model. The question that decides whether a multi-model strategy survives production is which layer chooses, on what grounds, and with what audit trail. Decide high, route low….
10. August 2026Single-vendor AI has become a single point of failure. Five drivers now make the case for a multi-model AI strategy across SaaS frontier models and self-hosted open weights, and the architecture underneath decides whether it works….
4. August 2026The Q3 2026 edition of the Trusted Agentic AI Landscape maps enterprise AI vendors on two axes, trust and lock-in, and explains why sovereignty, open weights, and agent-layer lock-in now decide the vendor choice. Free PDF with the full…
27. July 2026Data integration and workflow orchestration get confused because both ship hundreds of connectors. This post draws the line: integration moves and reshapes data, orchestration coordinates what runs across categories and recovers when…
22. July 2026Process intelligence has become three things, not one: mining, orchestration, and a decision gate. Here is how they fit, why agentic AI raises the stakes, and the four choices that keep your options open. Full vendor landscape as a free PDF….
17. July 2026AMQP, JMS, Kafka, and MQTT get compared as rivals, but a message broker, a log, and a device protocol sit on different layers. A clear guide to what each is, how they differ, when to use which, and why one platform often supports…