Solution Study: Optimize AI platform for model training and serving with PyTorch, Ray and Alluxio

Session

Optimize AI platform for model training and serving with PyTorch, Ray and Alluxio

Solution Study

Tuesday, July 01

10:00 AM - 10:30 AM

Live in San Francisco

Less Details

The automotive industry heavily relies on AI platforms for model training and serving. However, the fragmented data tool landscape and legacy platforms hinder the scalability and efficiency of AI platforms. This talk addresses the challenges faced by data platform teams, such as slow data loading using PyTorch and Ray, low GPU utilization, and high costs associated with retrieving data from cloud object storage. In this session, Bin Fan and Tarik Bennett will share their insights and solutions from production experiences, demonstrating how Alluxio helps automotive and smart vehicle companies maximize their AI infrastructure.

Learn more about new trends and challenges faced by data platform teams in the cloud and generative AI era
Discover a new stack with a combination of PyTorch/Ray and Alluxio to achieve fast data access, high GPU utilization, and lower cloud costs
Deep dive into real-world production use cases and example journeys for architecting a modern data platform for model training and serving

AI, Machine Learning, Reinforcement Learning, Deep Learning

Data Management, Fusion, Labelling, Annotation, Storage

Presentation

Testing, Validation, Simulation

Speaker

Bin Fan

VP of Technology, Alluxio, Inc.

Bin Fan is the VP of Technology at Alluxio. Prior to joining Alluxio as a founding engineer, he worked for Google to build the next-generation storage infrastructure. Bin received his PhD in computer science from Carnegie Mellon University on the design and implementation of distributed systems.

The Pop in Your Job – What drives you? Why do you love your job?
I’m passionate about solving complex technical challenges that have a real-world impact. I love working on distributed systems and storage infrastructure because they form the critical foundation that powers all the incredible applications, from the Hadoop era to the GenAI era.

Join Bin Fan
Book Now!

Company

Alluxio, Inc.

https://www.alluxio.io

Proven at global web scale in production for modern data services, Alluxio is the developer of open source data orchestration software for the cloud. Alluxio moves data closer to big data and machine learning compute frameworks in any cloud across clusters, regions, clouds and countries, providing memory-speed data access to files and objects. Intelligent data tiering and data management deliver consistent high performance to customers in financial services, high tech, retail and telecommunications. Alluxio is in production use today at seven out of the top ten internet companies. Venture-backed by Andreessen Horowitz and Seven Seas Partners, Alluxio was founded at UC Berkeley’s AMPLab by the creators of the Tachyon open source project.

Get Agenda

BOOK NOW