AWS re:Invent 2015   /     (CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015

Summary

It's difficult to find off-the-shelf, open-source solutions for creating lean, simple, and language-agnostic data-processing pipelines for machine learning (ML). This session shows you how to use Amazon S3, Docker, Amazon EC2, Auto Scaling, and a number of open source libraries as cornerstones to build one. We also share our experience creating elastically scalable and robust ML infrastructure leveraging the Spot instance market.

Subtitle
(CMP310) Building Robust Data Processing Pipelines Using Containers and Spot Instances | AWS re:Invent 2015
Duration
0:34:22
Publishing date
2015-10-09 18:30
Contributors
  Oleg Avdeev - AdRoll,
author  
Enclosures
https://s3.amazonaws.com/reinvent-podcasts/2015-audio/CMP310.mp3
audio/mpeg