In today's data-driven world, the ability to efficiently manage and transform data is crucial for any organization. This presentation will explore the process of converting a complex and messy workflow into a clean and simple Lakeflow Declarative Pipelines at a large integrated health system, Intermountain Health.Alteryx is a powerful tool for data preparation and blending, but as workflows grow in complexity, they can become difficult to manage and maintain. Lakeflow Declarative Pipelines, on the other hand, offers a more democratized, streamlined and scalable approach to data engineering, leveraging the power of Apache Spark and Delta Lake.We will begin by examining a typical legacy workflow, identifying common pain points such as tangled logic, performance bottlenecks and maintenance challenges. Next, we will demonstrate how to translate this workflow into a Lakeflow Declarative Pipelines, highlighting key steps such as data transformation, validation and delivery.
talk-data.com
Topic
Alteryx
low_code
data_preparation
data_blending
analytics
1
tagged
Activity Trend
6
peak/qtr
2020-Q1
2026-Q1
Top Events
DataFramed
4
O'Reilly Data Science Books
3
Big Data & AI Paris 2025
3
Big Data LDN 2024
2
O'Reilly Data Engineering Books
2
Big Data LDN 2025
2
Mavens of Data
2
Secrets of Data Analytics Leaders
2
PyData Paris 2025
2
Hub & Spoken: Data | Analytics | Chief Data Officer | CDO | Data Strategy
1
dbt Coalesce 2025
1
Data Career Podcast: Helping You Land a Data Analyst Job FAST
1
Filtering by:
Peter Jones
×