Scott Haines is a software engineer at Buf specializing in massive distributed data systems and streaming technologies. Over the past decade he has built and scaled data infrastructure at Yahoo!, Twilio, Nike, and now Buf, with deep expertise in distributed data architectures, streaming pipelines, Apache Spark, and Delta Lake. He is the author of books on Apache Spark and Delta Lake, and helps organizations adopt open-source technologies through teaching and consulting. He has over 20 years of experience across the software stack, with roles at Hitachi Data Systems, Convo Communications, Yahoo!, Twilio, and Nike.