Speaker: Daniel Poon, Wego

cron has been the go-to solution for scheduling tasks on remote Linux systems. In this session we will be speaking on the motivation for moving task scheduling to Airflow, as well as deep diving into the infrastructure designed for reliable task deployment and scheduling. We'll be demonstrating an end-to-end deployment and running of a sample ML task on this infrastructure.

Daniel is a Lead Engineer at Wego with the Content, Tools and Services team. He focuses on designing sane, user-friendly workflows to enhance the capabilities of internal stakeholders.

Event Page: https://www.meetup.com/PyData-SG/events/252822354

Produced by Engineers.SG

Help us caption & translate this video!

https://amara.org/v/k1Ta/