talk-data.com talk-data.com

P

Speaker

Pankaj Yawale

1

talks

Pankaj Yawale is a Senior Principal Architect, ZoomInfo

Pankaj Yawale is a Senior Principal Architect at ZoomInfo, based in Boston, MA. Pankaj has a bachelor's degree in Electrical Engineering. His passion for technology transcends his official role. Pankaj enjoys exploring new innovations, learning new skills, and solving complex problems with cutting-edge tools. Technology is not just his job, but his hobby and his inspiration.

Pankaj has been in the tech industry for 24 years and has worked on software systems in various business domains. Starting his career as a programmer in C, C++ and Java, and then moving on to Enterprise Architecture, he switched to Big Data a decade ago and developed a special passion for solving problems that involve data at large scale. He loves using technologies and patterns to solve complex data related problems. He is a big fan of Data Mesh and the concept of Data as a Product.

Bio from: Data Universe 2024

Filter by Event / Source

Talks & appearances

1 activities · Newest first

Search activities →

Data processing across systems relies on data lineage, a crucial aspect that tracks the movement and transformation of data records. Data lineage is necessary for Data Operations and Governance that support incident response, legal investigations, and privacy and compliance standards. However, things can go wrong due to the proprietary hand-coded business logic that alters the data. When that happens, the current data lineage systems that operate at the dataset/table level are not very helpful. They require additional analysis effort that can be expensive and time-consuming. In today's data landscape, we need a record-level lineage that can pinpoint the exact source and cause of data issues with minimal manual intervention. This problem has long been neglected due to its complexity, but we have a solution to propose. In this presentation, we will introduce a novel concept and its reference implementation using Starburst Enterprise Platform.