Stream-1st Architecture, Apache Flink & Other Emerging Technologies - PyDataSG

Published on: Tuesday, 6 December 2016

Speaker: Ellen Friedman (@Ellen_Friedman)

Abstract: There’s a revolution underway in how people work with data. Streaming data is no longer seen as a special use case – and that’s good a thing given that streaming is a better fit to the way life happens. This talk takes a look at the benefits of stream-first architecture and some of the emerging technologies that enable best practices with streaming. These include message transport with Apache Kafka or MapR Streams, and stream processing with Apache Flink. As a top level Apache project, Flink has an active and growing international community. The Flink engine offers robust, accurate and highly scalable real time stream processing, and it also works in batch. We’ll briefly explore how these new approaches and technologies are being put to use in real world situations.

Ellen Friedman is a consultant and commentator on big data topics. Active in open source, Ellen is committer for Apache Drill and Apache Mahout projects. She has a PhD in biochemistry, years of experience as a research scientist and has written about a wide range of technical topics. She is co-author of many short O’Reilly big data books including the Practical Machine Learning series, Time Series Databases, Streaming Architecture and the latest, Introduction to Apache Flink. Follow Ellen Twitter as @Ellen_Friedman.

Event Page:

Produced by Engineers.SG

Help us caption & translate this video!