Speaker: Hu Dawei (David)

In this presentation, we will learn how to design and assemble a complete Spark application and submit / run / modify the job on the fly.

We will see a demo of how various node can just be dragged and dropped through the web interface, with an explanation along the way about the overall design and Apache Livy as one of the key tools that makes this possible.

Presenter(s): Hu Dawei, System Engineer @ Qubida Analytics
Dawei is a System Engineer at Qubida, responsible for the back-end services that supports the Qubida web platform, such as Big Data ingestion, Spark job execution / scheduling, ML workflow visualization, etc.

Sponsor(s): Thanks to RedMart for sponsoring our venue and refreshments.

Event Page: https://www.meetup.com/Singapore-Scala-Programmers/events/246818263/

Produced by Engineers.SG

Help us caption & translate this video!

https://amara.org/v/eSDI/