talk-data.com talk-data.com

Meetup Talk 2023-09-14 at 19:00

GPU: 'Greatly Problematic Units'? - Tales from the Trenches of Resource Allocation

Description

In the realm of AI, GPUs play a crucial role in data science projects. Yet, squeezing the most out of them is a challenge, particularly for data scientists with limited resources and time. This talk explores the often-overlooked world of GPU orchestration and allocation with a dash of humour. We’ll address common mistakes like underutilization, static assignments, and resource sharing pitfalls. Introducing Genv, an open-source tool, we’ll transform these challenges into opportunities for seamless and efficient AI workflows.