Loading…
Vancouver, BC, Canada
August 27 & 28 - Co-Located Events, Tutorials, Labs & Lightning Talks
August 29-31 - Conference
Click Here For Information & Registration
Back To Schedule
Wednesday, August 29 • 2:10pm - 2:50pm
"CASE": A Mesos Scheduler for Distributed Machine Learning - Karthik Anantha Padmanabhan & Steven Bairos-Novak, Pinterest

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Many machine learning frameworks support distributed training of models. Distributed training is becoming increasingly important as organizations train on larger datasets with increased importance on reducing the overall training time. Every ML framework comes with its own specification on how to do distributed machine learning. Typically all of them have their own notion of workers and have a mechanism on how these workers communicate to update and share their learnt parameters.The lifecycle of these workers needs to managed differently for different ML frameworks and typically requires the use of an external cluster manager to schedule workers on machines and manage their lifecycle. In this talk, Karthik will talk about "Case", a Mesos batch scheduler that supports launching and managing the lifecycle of workers across multiple ML frameworks ( Tensorflow, LightGBM, XGBoost etc ).


Speakers
SB

Steven Bairos-Novak

Software Engineer, Pinterest
KA

Karthik Anantha Padmanabhan

Software Engineer
Karthik is a Software Engineer working on Data and ML Infra at Pinterest. He is working on enabling machine learning engineers and data scientist to easily perform large scale machine learning across different ML frameworks. Previously he was at Twitter working on scheduling containers... Read More →



Wednesday August 29, 2018 2:10pm - 2:50pm PDT
Room 116/117