The Shift Left Architecture – From Batch and Lakehouse to Real-Time Data Products with Data Streaming

2 years ago

Data integration is a hard challenge in every enterprise. Batch processing and Reverse ETL are common practices in a data…

Apache Kafka in Manufacturing at Automotive Supplier Brose for Industrial IoT Use Cases

2 years ago

Data streaming unifies OT/IT workloads by connecting information from sensors, PLCs, robotics and other manufacturing systems at the edge with…

Real-Time GenAI with RAG using Apache Kafka and Flink to Prevent Hallucinations

2 years ago

How do you prevent hallucinations from large language models (LLMs) in GenAI applications? LLMs need real-time, contextualized, and trustworthy data…

Open Standards for Data Lineage: OpenLineage for Batch AND Streaming

2 years ago

One of the greatest wishes of companies is end-to-end visibility in their operational and analytical workflows. Where does data come…

My Data Streaming Journey with Kafka & Flink: 7 Years at Confluent

2 years ago

Time flies… I joined Confluent seven years ago when Apache Kafka was mainly used by a few tech giants and…

Apache Kafka + Flink + Snowflake: Cost Efficient Analytics and Data Governance

2 years ago

Snowflake is a leading cloud data warehouse and transitions into a data cloud that enables various use cases. The major…

Snowflake Data Integration Options for Apache Kafka (including Iceberg)

2 years ago

The integration between Apache Kafka and Snowflake is often cumbersome. Options include near real-time ingestion with a Kafka Connect connector,…

Snowflake Integration Patterns: Zero ETL and Reverse ETL vs. Apache Kafka

2 years ago

Snowflake is a leading cloud-native data warehouse. Integration patterns include batch data integration, Zero ETL and near real-time data ingestion…

When (Not) to Choose Google Managed Service for Apache Kafka?

2 years ago

Google announced its Apache Kafka for BigQuery cloud service at its conference Google Cloud Next 2024 in Las Vegas. Welcome…

Apache Kafka and Tinybird (ClickHouse) for Streaming Analytics HTTP APIs

2 years ago

Apache Kafka became the de facto standard for data streaming. However, the combination of an event-driven architecture with request-response APIs…