Data Engineering Podcast

0 Likes     0 Followers     1 Subscribers

Sign up / Log in to like, follow, recommend and subscribe!

Recommendations


Episodes

Date Title & Description Contributors
2024-12-01

  The Art of Database Selection and Evolution

SummaryIn this episode of the Data Engineering Podcast Sam Kleinman talks about the pivotal role of databases in software engineering. Sam shares his journey into the world of data and discusses the complexities of database selection, highlighting the ...
  Tobias Macey author
2024-11-26

  Bridging Code and UI in Data Orchestration with Kestra

SummaryIn this episode of the Data Engineering Podcast, Anna Geller talks about the integration of code and UI-driven interfaces for data orchestration. Anna defines data orchestration as automating the coordination of workflow nodes that interact with...
  Tobias Macey author
2024-11-18

  Streaming Data Into The Lakehouse With Iceberg And Trino At Going

In this episode, I had the pleasure of speaking with Ken Pickering, VP of Engineering at Going, about the intricacies of streaming data into a Trino and Iceberg lakehouse. Ken shared his journey from product engineering to becoming deeply involved in d...
  Tobias Macey author
2024-11-11

  An Opinionated Look At End-to-end Code Only Analytical Workflows With Bruin

SummaryThe challenges of integrating all of the tools in the modern data stack has led to a new generation of tools that focus on a fully integrated workflow. At the same time, there have been many approaches to how much of the workflow is driven by co...
  Tobias Macey author
2024-11-04

  Feldera: Bridging Batch and Streaming with Incremental Computation

SummaryIn this episode of the Data Engineering Podcast, the creators of Feldera talk about their incremental compute engine designed for continuous computation of data, machine learning, and AI workloads. The discussion covers the concept of incrementa...
  Tobias Macey author
2024-10-27

  Accelerate Migration Of Your Data Warehouse with Datafold's AI Powered Migration Agent

SummaryGleb Mezhanskiy, CEO and co-founder of DataFold, joins Tobias Macey to discuss the challenges and innovations in data migrations. Gleb shares his experiences building and scaling data platforms at companies like Autodesk and Lyft, and how these ...
  Tobias Macey author
2024-10-20

  Bring Vector Search And Storage To The Data Lake With Lance

SummaryThe rapid growth of generative AI applications has prompted a surge of investment in vector databases. While there are numerous engines available now, Lance is designed to integrate with data lake and lakehouse architectures. In this episode Wes...
  Tobias Macey author
2024-10-13

  The Role of Python in Shaping the Future of Data Platforms with DLT

SummaryIn this episode of the Data Engineering Podcast, Adrian Broderieux and Marcin Rudolph, co-founders of DLT Hub, delve into the principles guiding DLT's development, emphasizing its role as a library rather than a platform, and its integration wit...
  Tobias Macey author
2024-10-06

  Build Your Data Transformations Faster And Safer With SDF

SummaryIn this episode of the Data Engineering Podcast Lukas Schulte, co-founder and CEO of SDF, explores the development and capabilities of this fast and expressive SQL transformation tool. From its origins as a solution for addressing data privacy, ...
  Tobias Macey author
2024-09-23

  Scaling Airbyte: Challenges and Milestones on the Road to 1.0

SummaryAirbyte is one of the most prominent platforms for data movement. Over the past 4 years they have invested heavily in solutions for scaling the self-hosted and cloud operations, as well as the quality and stability of their connectors. As a resu...
  Tobias Macey author