Data Engineering Podcast

0 Likes     0 Followers     1 Subscribers

Sign up / Log in to like, follow, recommend and subscribe!

Recommendations


Episodes

Date Title & Description Contributors
2025-01-13

  CSVs Will Never Die And OneSchema Is Counting On It

SummaryIn this episode of the Data Engineering Podcast Andrew Luo, CEO of OneSchema, talks about handling CSV data in business operations. Andrew shares his background in data engineering and CRM migration, which led to the creation of OneSchema, a pla...
  Tobias Macey author
2025-01-03

  Breaking Down Data Silos: AI and ML in Master Data Management

SummaryIn this episode of the Data Engineering Podcast Dan Bruckner, co-founder and CTO of Tamr, talks about the application of machine learning (ML) and artificial intelligence (AI) in master data management (MDM). Dan shares his journey from working ...
  Tobias Macey author
2024-12-23

  Building a Data Vision Board: A Guide to Strategic Planning

SummaryIn this episode of the Data Engineering Podcast Lior Barak shares his insights on developing a three-year strategic vision for data management. He discusses the importance of having a strategic plan for data, highlighting the need for data teams...
  Tobias Macey author
2024-12-16

  How Orchestration Impacts Data Platform Architecture

SummaryThe core task of data engineering is managing the flows of data through an organization. In order to ensure those flows are executing on schedule and without error is the role of the data orchestrator. Which orchestration engine you choose impac...
  Tobias Macey author
2024-12-08

  An Exploration Of The Impediments To Reusable Data Pipelines

SummaryIn this episode of the Data Engineering Podcast the inimitable Max Beauchemin talks about reusability in data pipelines. The conversation explores the "write everything twice" problem, where similar pipelines are built without code reuse, and di...
  Tobias Macey author
2024-12-01

  The Art of Database Selection and Evolution

SummaryIn this episode of the Data Engineering Podcast Sam Kleinman talks about the pivotal role of databases in software engineering. Sam shares his journey into the world of data and discusses the complexities of database selection, highlighting the ...
  Tobias Macey author
2024-11-26

  Bridging Code and UI in Data Orchestration with Kestra

SummaryIn this episode of the Data Engineering Podcast, Anna Geller talks about the integration of code and UI-driven interfaces for data orchestration. Anna defines data orchestration as automating the coordination of workflow nodes that interact with...
  Tobias Macey author
2024-11-18

  Streaming Data Into The Lakehouse With Iceberg And Trino At Going

In this episode, I had the pleasure of speaking with Ken Pickering, VP of Engineering at Going, about the intricacies of streaming data into a Trino and Iceberg lakehouse. Ken shared his journey from product engineering to becoming deeply involved in d...
  Tobias Macey author
2024-11-11

  An Opinionated Look At End-to-end Code Only Analytical Workflows With Bruin

SummaryThe challenges of integrating all of the tools in the modern data stack has led to a new generation of tools that focus on a fully integrated workflow. At the same time, there have been many approaches to how much of the workflow is driven by co...
  Tobias Macey author
2024-11-04

  Feldera: Bridging Batch and Streaming with Incremental Computation

SummaryIn this episode of the Data Engineering Podcast, the creators of Feldera talk about their incremental compute engine designed for continuous computation of data, machine learning, and AI workloads. The discussion covers the concept of incrementa...
  Tobias Macey author