Modal and Scaling AI Inference with Erik Bernhardsson

Modal is a serverless compute platform that’s particularly targeted on AI workloads. The corporate’s objective is to allow AI groups to rapidly spin up GPU-enabled containers, and quickly iterate and autoscale.

It was based by Erik Bernhardsson who was beforehand at Spotify for 7 years the place he constructed the music suggestion system and the favored Luigi workflow scheduler.

On this episode, Erik joins Sean Falconer to speak concerning the motivation for founding his firm, the market hole in ML and AI tooling, optimizing container chilly begin, Modal’s interface design, and extra.

Sean’s been an instructional, startup founder, and Googler. He has printed works overlaying a variety of subjects from AI to quantum computing. At the moment, Sean is an AI Entrepreneur in Residence at Confluent the place he works on AI technique and thought management. You’ll be able to join with Sean on LinkedIn.