talk-data.com
PyData
talk
2023-04-18 at 12:10
Data-driven design for the Dask scheduler
Event:
PyConDE & PyData Berlin 2023
Speakers
Description
Historically, changes in the scheduling algorithm of Dask have often been based on theory, single use cases, or even gut feeling. Coiled has now moved to using hard, comprehensive performance metrics for all changes - and it's been a turning point!