Keeping the “fun” in Apache Spark: Datasets and FP
Jun 20, 2018
Speakers
Holden Karau
Speaker · 0 followers
About
Apache Spark has been a great driver of not only Scala adoption, but introducing a new generation of developers to functional programming concepts. As Spark places more emphasis on its newer DataFrame & Dataset APIs, it’s important to ask ourselves how we can benefit from this while still keeping our fun functional roots. We will explore the cases where the Dataset APIs empower us to do cool things we couldn’t before, what the different approaches to serialization mean, and how to figure out when the shiny new API is actually just trying to steal your lunch money (aka CPU cycles).Apache Spark has been a great driver of not only Scala adoption, but introducing a new generation of developers to functional programming concepts. As Spark places more emphasis on its newer DataFrame & Dataset APIs, it’s important to ask ourselves how we can benefit from this while still keeping our fun functional roots. We will explore the cases where the Dataset APIs empower us to do cool things we couldn’t before, what the different approaches to serialization mean, and how to figure ou…
Organizer
Scala Days
Account · 249 followers
Categories
Software & Programming
Category · 1k presentations
AI & Data Science
Category · 10.8k presentations
About Scala Days
Scala Days brings together developers from all corners of the world to share their experiences and new ideas around creating applications with Scala and related technologies, like Spark, Kafka, and Akka. Scala Days provides a unique opportunity for Scala users to interact with the contributors to the language and related technologies and connect with fellow developers.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Compiling Scala Faster with GraalVM
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Starting from Scratch with Scala Native
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Oh, All the things you'll traverse
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Keeping the "fun" in Apache Spark: Datasets and FP
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Functional interpreters and you
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Your Type System Working for You
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%