ETL and Event Streaming Explained ft. Stewart Bryson

Migrating from traditional ETL tools to an event streaming platform is a process that Stewart Bryson (CEO and founder, Red Pill Analytics), is no stranger to. In this episode, he dispels misconceptions around what “streaming ETL” means, and explains why event streaming and event-driven architectures compel us to rethink old approaches:

• Not all data is corporate data anymore
• Not all data is relational data anymore
• The cost of storing data is now negligible

Supporting modern, distributed event streaming platforms, and the shift of focus from on-premises to the cloud introduces new use cases that focus primarily on building new systems and rebuilding existing ones. 

From Kafka Connect and stack applications to the importance of tables, events, and logs, Stewart also discusses Gradle and how it’s being used at Red Pill Analytics. 

EPISODE LINKS

• Deploying Kafka Streams and KSQL with Gradle – Part 1: Overview and Motivation
• Deploying Kafka Streams and KSQL with Gradle – Part 2: Managing KSQL Implementations
• Deploying Kafka Streams and KSQL with Gradle – Part 3: KSQL User-Defined Functions and Kafka Streams 
• Join the Confluent Community Slack
• Fully managed Apache Kafka as a service! Try free.

Episode source