Regardless of profession, the work we do leaves behind a trace of actions that help us achieve our goals. This is especially true for those that work with data. For large enterprises where there are seemingly countless processes happening at any one time, keeping track of these processes is crucial. Given the scale of these processes, one small efficiency gain can leads to a staggering amount of time and money saved. Process mining is a data-driven approach to process analysis that uses event logs to extract process-related information. It can separate inferred facts, from exact truths, and uncover what really happens in a variety of operations.  Wil van der Aalst is a full professor at RWTH Aachen University, leading the Process and Data Science (PADS) group. He is also the Chief Scientist at Celonis, part-time affiliated with the Fraunhofer FIT, and a member of the Board of Governors of Tilburg University.  His research interests include process mining, Petri nets, business process management, workflow management, process modeling, and process analysis. Wil van der Aalst has published over 275 journal papers, 35 books (as author or editor), 630 refereed conference/workshop publications, and 85 book chapters. Cong Yu leads the CeloAI group at Celonis focusing on bringing advanced AI technologies to EMS products, building up capabilities for their knowledge platform, and ultimately helping enterprises in reducing process inefficiencies and achieving operational excellence. Previously, Cong was Principal (Research) Scientist / Research Director at Google Research NYC from September 2010 to July 2022, leading the NYSD/Beacon Research Group, and also taught at NYU Courant Institute of Mathematical Sciences.  In the episode, Wil, Cong, and Richie explore process mining and its development over the past 25 years, the differences between process mining and ML, AI, and data mining, popular use cases of process mining, adoption from large enterprises like BMW, HP, and Dell, the requirements for an effective process mining system, the role of predictive analytics and data engineering in process mining, how to scale process mining systems, prospects within the field and much more. Links Mentioned in the Show: CelonisGartner’s Magic Quadrant for Process MiningPM4PyProcess Query Language (PQL)[Couse] Business Process Analytics in R

There are a few caveats to using generative AI tools, those caveats have led to a few tips that have quickly become second nature to those that use LLMs like ChatGPT. The main one being: have the domain knowledge to validate the output in order to avoid hallucinations. Hallucinations are one of the weak spots for LLMs due to the nature of the way they are built, as they are trained to correlate data in order to predict what might come next in an incomplete sequence. Does this mean that we’ll always have to be wary of the output of AI products, with the expectation that there is no intelligent decision-making going on under the hood? Far from it. Causal AI is bound by reason—rather than looking at correlation, these exciting systems are able to focus on the underlying causal mechanisms and relationships. As the AI field rapidly evolves, Causal AI is an area of research that is likely to have a huge impact on a huge number of industries and problems.  Paul Hünermund is an Assistant Professor of Strategy and Innovation at Copenhagen Business School. In his research, Dr. Hünermund studies how firms can leverage new technologies in the space of machine learning and artificial intelligence such as Causal AI for value creation and competitive advantage. His work explores the potential for biases in organizational decision-making and ways for managers to counter them. It thereby sheds light on the origins of effective business strategies in markets characterized by a high degree of technological competition and the resulting implications for economic growth and environmental sustainability.  His work has been published in The Journal of Management Studies, the Econometrics Journal, Research Policy, Journal of Product Innovation Management, International Journal of Industrial Organization, MIT Sloan Management Review, and Harvard Business Review, among others.  In the full episode, Richie and Paul explore Causal AI, its differences when compared to other forms of AI, use cases of Causal AI in fields like drug development, marketing, manufacturing, and defense. They also discuss how Causal AI contributes to better decision-making, the role of domain experts in getting accurate results, what happens in the early stages of Causal AI adoption, exciting new developments within the Causal AI space and much more.  Links Mentioned in the Show: Causal Data Science in BusinessCausal AI by causaLensIntro to Causal AI Using the DoWhy Library in PythonLesson: Inference (causal) models

Over the past year, we’ve seen a full hype cycle of hysteria and discourse surrounding generative AI. It almost seems difficult to think back to a time when no one had used ChatGPT. We are in the midst of the fourth industrial revolution, and technology is moving rapidly. Better performing and more capable models are being released at a stunning rate, and with the growing presence of multimodal AI, can we expect another whirlwind year that vastly changes the state of play within AI again? Who might be able to provide insight into what is to come in 2024? Craig S. Smith is an American journalist, former executive of The New York Times, and host of the podcast Eye on AI. Until January 2000, he wrote for The Wall Street Journal, most notably covering the rise of the religious movement Falun Gong in China. He has reported for the Times from more than 40 countries and has covered several conflicts, including the 2001 invasion of Afghanistan, the 2003 war in Iraq, and the 2006 Israeli-Lebanese war. He retired from the Times in 2018 and now writes about artificial intelligence for the Times and other publications. He was a special Government employee for the National Security Commission on Artificial Intelligence until the commission's end in October 2021.  In the episode, Richie and Craig explore the 2023 advancements in generative AI, such as GPT-4, and the evolving roles of companies like Anthropic and Meta, practical AI applications for research and image generation, challenges in large language models, the promising future of world models and AI agents, the societal impacts of AI, the issue of misinformation, computational constraints, and the importance of AI literacy in the job market, the transformative potential of AI in various sectors and much more.  Links Mentioned in the Show: Eye on AIWayveAnthropicCohereMidjourneyYann Lecun

Poor data engineering is like building a shaky foundation for a house—it leads to unreliable information, wasted time and money, and even legal problems, making everything less dependable and more troublesome in our digital world. In the retail industry specifically, data engineering is particularly important for managing and analyzing large volumes of sales, inventory, and customer data, enabling better demand forecasting, inventory optimization, and personalized customer experiences. It helps retailers make informed decisions, streamline operations, and remain competitive in a rapidly evolving market. Insight and frameworks learned from data engineering practices can be applied to a multitude of people and problems, and in turn, learning from someone who has been at the forefront of data engineering is invaluable.   Mohammad Sabah is SVP of Engineering and Data at Thrive Market, and was appointed to this role in 2018. He joined the company from The Honest Company where he served as VP of Engineering & Chief Data Scientist. Sabah joined The Honest Company following its acquisition of Insnap, which he co-founded in 2015. Over the course of his career, Sabah has held various data science and engineering roles at companies including Facebook, Workday, Netflix, and Yahoo! In the episode, Richie and Mo explore the importance of using AI to identify patterns and proactively address common errors, the use of tools like dbt and SODA for data pipeline abstraction and stakeholder involvement in data quality, data governance and data quality as foundations for strong data engineering, validation layers at each step of the data pipeline to ensure data quality, collaboration between data analysts and data engineers for holistic problem-solving and reusability of patterns, ownership mentality in data engineering and much more.  Links from the show: PagerDutyDomoOpsGeneCareer Track: Data Engineer

In 2015 an MIT Researcher set out to build a mirror that would augment their face to look like those of their idols. The execution of this went well, until it came to testing. When the researcher came to use the mirror, no face was detected. The researcher was not detected in the mirror, until that is, she put on a white mask, at which point, the mirror worked as expected.  Three years later, a paper named ‘Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification’ was published by the same researcher. Its release started a wider conversation about bias within AI-based facial recognition systems, and about bias within AI in general. Work to fight against algorithmic bias, or ‘The Coded-Gaze’, has been ongoing since. But who spearheaded this work and highlighted these issues to the AI and tech community?  Dr. Joy Buolamwini is an AI researcher, artist, and advocate. In 2023, she is one of Time’s top 100 most influential people in AI. Joy founded the Algorithmic Justice League to create a world with more equitable and accountable technology. Her TED Featured Talk on algorithmic bias has over 1.5 million views and in 2020 Netflix released the documentary ‘Coded Bias’ following Joy’s research into the flaws of facial recognition systems. Her MIT thesis methodology uncovered large racial and gender bias in AI services from companies like Microsoft, IBM, and Amazon. Her research has been covered in over 40 countries, and as a renowned international speaker she has championed the need for algorithmic justice at the World Economic Forum and the United Nations. She serves on the Global Tech Panel convened by the vice president of European Commission to advise world leaders and technology executives on ways to reduce the harms of A.I. As a creative science communicator, she has written op-eds on the impact of artificial intelligence for publications like TIME Magazine and New York Times. Her spoken word visual audit "AI, Ain't I A Woman?" which shows AI failures on the faces of iconic women like Oprah Winfrey, Michelle Obama, and Serena Williams as well as the Coded Gaze short have been part of exhibitions ranging from the Museum of Fine Arts, Boston to the Barbican Centre, UK. A Rhodes Scholar and Fulbright Fellow, Joy has been named to notable lists including Bloomberg 50, Tech Review 35 under 35, , Forbes Top 50 Women in Tech (youngest), and Forbes 30 under 30. She holds two masters degrees from Oxford University and MIT; and a bachelor's degree in Computer Science from the Georgia Institute of Technology. Fortune Magazine named her to their 2019 list of world's greatest leaders describing her as "the conscience of the A.I. Revolution." In the episode, Richie and Joy discuss her journey into AI, the ethics of AI, the inception of Joy’s interest in AI bias, the Aspire Mirror and Gender Shades projects, The Algorithmic Justice League, consequences of biased facial recognition systems, highlights from Joy’s book (Unmasking AI), challenges in AI research such as misleading datasets and the importance of context, balancing working in AI and data while being an artist, and much more.  Links mentioned in the show: Unmasking AI by Joy BuolamwiniAlgorithmic Justice LeagueGender Shades ProjectThe Coded Gaze

From the dawn of humanity, decisions, both big and small, have shaped our trajectory. Decisions have built civilizations, forged alliances, and even charted the course of our very evolution. And now, as data & AI become more widespread, the potential upside for better decision making is massive. Yet, like any technology, the true value of data & AI is realized by how we wield it.  We're often drawn to the allure of the latest tools and techniques, but it's crucial to remember that these tools are only as effective as the decisions we make with them. ChatGPT is only as good as the prompt you decide to feed it and what you decide to do with the output. A dashboard is only as good as the decisions that it influences. Even a data science team is only as effective as the value they deliver to the organization.  So in this vast landscape of data and AI, how can we master the art of better decision making? How can we bridge data & AI with better decision intelligence? ​​Cassie Kozyrkov founded the field of Decision Intelligence at Google where, until recently, she served as Chief Decision Scientist, advising leadership on decision process, AI strategy, and building data-driven organizations. Upon leaving Google, Cassie started her own company of which she is the CEO, Data Scientific. In almost 10 years at the company, Cassie personally trained over 20,000 Googlers in data-driven decision-making and AI and has helped over 500 projects implement decision intelligence best practices. Cassie also previously served in Google's Office of the CTO as Chief Data Scientist, and the rest of her 20 years of experience was split between consulting, data science, lecturing, and academia.  Cassie is a top keynote speaker and a beloved personality in the data leadership community, followed by over half a million tech professionals. If you've ever went on a reading spree about AI, statistics, or decision-making, chances are you've encountered her writing, which has reached millions of readers.  In the episode Cassie and Richie explore misconceptions around data science, stereotypes associated with being a data scientist, what the reality of working in data science is, advice for those starting their career in data science, and the challenges of being a data ‘jack-of-all-trades’.  Cassie also shares what decision-science and decision intelligence are, what questions to ask future employers in any data science interview, the importance of collaboration between decision-makers and domain experts, the differences between data science models and their real-world implementations, the pros and cons of generative AI in data science, and much more.  Links mentioned in the Show: Data scientist: The sexiest job of the 22nd centuryThe Netflix PrizeAI Products: Kitchen AnalogyType one, Two & Three Errors in StatisticsCourse: Data-Driven Decision Making for BusinessRadar: Data & AI Literacy...

The mainstreaming of data & AI is fundamentally altering the way we work and operate. But with rising innovation, comes rising ambiguity and complexity. How can leaders effectively navigate the path ahead? How can leaders adopt data-driven decision-making and learn from their mistakes? How can leaders use data to look inward, and become what today’s guest describes as “meta-leaders”?  Constance Dierickx is an internationally recognized expert in high-stakes decision-making who has advised leaders and delivered speeches in more than 20 countries. Founder and president of CD Consulting Group, her clients include Fortune 20 companies, private equity firms, and large not-for-profits around the globe. She is a contributor to Harvard Business Review, Forbes, Chief Executive, and others, and has taught strategic decision-making at Skolkovo Institute of Science and Technology in Moscow, Russia.  In the episode, Richie and Constance delve into what meta-leadership is, the nuances of meta-leadership, the pivotal role of data in leadership, the importance of recognizing subtle behavioral cues, the implications of cognitive biases (particularly overconfidence), and the essence of wisdom in decision-making. Constance also shares insights from her clinical psychology background, highlighting the application of biofeedback mechanisms in managing chronic pain and much more.  Links From the Show: Meta-Leadership by Constance Dierickx High-Stakes Leadership by Constance Dierickx The Merger Mindset by Constance Dierickx Design the Life You Love: A Step-by-Step Guide to Building a Meaningful Future Book by Ayse Birsel Introducing The State of Data Literacy Report 2023 Data-Driven Decision Making for Business

Throughout history, small businesses have consistently played a pivotal role in the global economy, serving as its foundational backbone. As we navigate the digital age, the emergence of large corporations and rapid technological advancements present new challenges. Now, more than ever, it's imperative for small businesses to adapt, embracing a data-driven approach to remain competitive and sustainable. In this evolving landscape, we need champions dedicated to guiding these businesses, ensuring they harness the full potential of modern tools and insights to ensure a fair and varied marketplace of goods and services for all.  Dr Kendra Vant, Executive General Manager of Data & AI Products at Xero, is an industry leader in building data-driven products that harness AI and machine learning to solve complex problems for the small-business economy. Working across Australia, Asia and the US, Kendra has led data and technology teams at companies such as Seek, Telstra, Deloitte and now Xero where she leads the company's global efforts using emerging practices and technologies to help small businesses and their advisors benefit from the power of data and insights. Starting with doctoral research in experimental quantum physics at MIT and a stint building quantum computers at Los Alamos National Laboratory, Kendra has made a career of solving hard problems and pushing the boundaries of what's possible. In the episode, Kendra and Richie delve into the transformative impact of data science on small businesses, use-cases of data science for small businesses, how Xero has supported numerous small businesses with data science. They also cover the integration of AI in product development, the unexpected depth of data in seemingly low-tech sectors, the pivotal role of software platforms in data analysis and much more.  Links Mentioned in The Show: Xero Analyzing Business Data in SQL Financial Modeling in Spreadsheets Implementing AI Solutions in Business Generative AI Concepts

As companies scale and become more successful, new horizons open, but with them come unexpected challenges. The influx of revenue and expansion of operations often reveal hidden complexities that can hinder efficiency and inflate costs. In this tricky situation, data teams can find themselves entangled in a web of obstacles that slow down their ability to innovate and respond to ever-changing business needs. Enter cloud analytics—a transformative solution that promises to break down barriers and unleash potential. By migrating analytics to the cloud, organizations can navigate the growing pains of success, cutting costs, enhancing flexibility, and empowering data teams to work with agility and precision. John Knieriemen is the Regional Business Lead for North America at Exasol, the market-leading high-performance analytics database. Prior to joining Exasol, he served as Vice President and General Manager at Teradata during an 11-year tenure with the company. John is responsible for strategically scaling Exasol’s North America business presence across industries and expanding the organization’s partner network.  Solongo Erdenekhuyag is the former Customer Success and Data Strategy Leader at Exasol. Solongo is skilled in strategy, business development, program management, leadership, strategic partnerships, and management. In the episode, Richie, Solongo, and John cover the motivation for moving analytics to the cloud, economic triggers for migration, success stories from organizations who have migrated to the cloud, the challenges and potential roadblocks in migration, the importance of flexibility and open-mindedness and much more.  Links from the Show ExasolAmazon S3Azure Blob StorageGoogle Cloud StorageBigQueryAmazon RedshiftSnowflake[Course] Understanding Cloud Computing[Course] AWS Cloud Concepts

Generative AI is here to stay—even in the 8 months since the public release of ChatGPT, there are an abundance of AI tools to help make us more productive at work and ease the stress of planning and execution of our daily lives among other things.  Already, many of us are wondering what is to come in the next 8 months, the next year, and the next decade of AI’s evolution. In the grand scheme of things, this really is just the beginning. But what should we expect in this Cambrian explosion of technology? What are the use cases being developed behind the scenes? What do we need to be mindful of when training the next generations of AI? Can we combine multiple LLMs to get better results? Bal Heroor is CEO and Principal at Mactores and has led over 150 business transformations driven by analytics and cutting-edge technology. His team at Mactores are researching and building AI, AR/VR, and Quantum computing solutions for business to gain a competitive advantage. Bal is also the Co-Founder of Aedeon—the first hyper-scale Marketplace for Data Analytics and AI talent. In the episode, Richie and Bal explore common use cases for generative AI, how it's evolving to solve enterprise problems, challenges of data governance and the importance of explainable AI, the challenges of tracking the lineage of AI and data in large organizations. Bal also touches on the shift from general-purpose generative AI models to more specialized models, fascinating use cases in the manufacturing industry, what to consider when adopting AI solutions in business, and much more. Links mentioned in the show: PulsarTrifactaAWS Clarify[Course] Introduction to ChatGPT[Course] Implementing AI Solutions in Business[Course] Generative AI Concepts

In a time when AI is evolving at breakneck speeds, taking a step back and gaining a bird's-eye view of the evolving AI ecosystem is paramount to understanding where the field is headed. With this bird's-eye view come a series of questions. Which trends will dominate generative AI in the foreseeable future? What are the truly transformative use-cases that will reshape our business landscape? What does the skills economy look like in an age of hyper intelligence? Enter Joanne Chen, General Partner at Foundation Capital. Joanne invests in early-stage AI-first B2B applications and data platforms that are the building blocks of the automated enterprise. She has shared her learnings as a featured speaker at conferences, including CES, SXSW, WebSummit, and has spoken about the impact of AI on society in her TED talk titled "Confessions of an AI Investor." Joanne began her career as an engineer at Cisco Systems and later co-founded a mobile gaming company. She also spent many years working on Wall Street at Jefferies & Company, helping tech companies go through the IPO and M&A processes, and at Probitas Partners, advising venture firms on their fundraising process. Throughout the episode, Richie and Joanne cover emerging trends in generative AI, business use cases that have emerged in the past year since the advent of tools like ChatGPT, the role of AI in augmenting work, the ever-changing job market and AI's impact on it, as well as actionable insights for individuals and organizations wanting to adopt AI. Links mentioned in the show: JasperAIAnyScaleCerebras[Course] Introduction to ChatGPT[Course] Implementing AI Solutions in Business[Course] Generative AI Concepts

Spreadsheets have been the unsung heroes of the data world for many decades now. Yet, despite their ubiquity and importance, they've seen little disruption or evolution. The grid of cells we interact with today isn't far removed from the ones our predecessors used in the 1980s. However, the winds of change have started to blow. As we stand on the cusp of a new era in data and AI, the humble spreadsheet is poised for transformation. The coming changes could redefine how we interact with data, derive insights, and how we make decisions. The implications are vast given the popularity and dependence we have on spreadsheets, and the potential impacts could ripple through every corner of the professional world.  Hjalmar Gislason is the founder and CEO of GRID, with their main product being a smart spreadsheet with an interactive data visualization layer and integrated AI assistance. Hjalmar previously served as VP of Product Management at Qlik. He was the founder and CEO of DataMarket, founded in 2008 and sold to Qlik in 2014. A career data nerd and entrepreneur, GRID is Hjalmar’s fifth software startup as a founder.  In the episode, Richie and Hjalmar explore the integral role of spreadsheets in today's data-driven world, the limitations of traditional Business Intelligence tools, and the transformative potential of generative AI in the realm of spreadsheets.

Data and AI are advancing at an unprecedented rate—and while the jury is still out on achieving superintelligent AI systems, the idea of artificial intelligence that can understand and learn anything—an “artificial general intelligence”—is becoming more likely. What does the rise of AI mean for the future of software and work as we know it? How will AI help reinvent most of the ways we interact with the digital and physical world? Bob Muglia is a data technology investor and business executive, former CEO of Snowflake, and past president of Microsoft's Server and Tools Division. As a leader in data & AI, Bob focuses on how innovation and ethical values can merge to shape the data economy's future in the era of AI. He serves as a board director for emerging companies that seek to maximize the power of data to help solve some of the world's most challenging problems. In the episode, Richie and Bob explore the current era of AI and what it means for the future of software. Throughout the episode, they discuss how to approach driving value with large language models, the main challenges organizations face when deploying AI systems, the risks, and rewards of fine-tuning LLMs for specific use cases, what the next 12 to 18 months hold for the burgeoning AI ecosystem, the likelihood of superintelligence within our lifetimes, and more. Links from the show: The Datapreneurs by Bob Muglia and Steve HammThe Singularity is Near by Ray KurzweilIsaac AsimovSnowflakePineconeDocugamiOpenAI/GPT-4The Modern Data Stack

Historically in elite team sports, there has often been a dynamic between players and their inherent abilities, and the vision of the coach. In many sports, we’ve seen coaching strategies influence the future of how the game is played. As the era of professionalism swept across many elite sports in the 90s, we saw the highest-level sports teams achieve a competitive edge by looking at the data, with sports fans often noticing a difference in the ‘feel’ of the way their team plays. In Basketball specifically, we have recently seen the rise of the 3-pointer, a riskier and much more difficult shot to accurately hit, even for professional players. But what has driven the rise of the 3-pointer? Is it another trend among coaches, or does the answer lie with data-based insights and the analysts producing these insights? Seth Partnow is the Director of North American Sports at StatsBomb, where he previously served as their Director of Basketball Analytics. Prior to joining StatsBomb in 2021, Seth was the Director of Basketball Research for the Milwaukee Bucks basketball team. Seth is also an accomplished Analyst and Author, having worked as an NBA Analyst for The Athletic since 2019 and having published his own book on basketball analytics, The Midrange Theory. Seth’s knowledge and insight bridges the gap between data analytics and elite US sport.  In the episode, Seth and Richie look into the intricate dynamics of elite basketball. Seth explores the challenges of attributing individual contributions in a sport where the outcome is significantly influenced by the complex interplay between players. Drawing from his extensive experience in the field, Seth discusses the complexities of analyzing player performance, the nuances of determining why certain players get easier or harder shots, and the difficulty of attributing credit for defensive achievements to individual players. Seth provides a comprehensive overview of the various roles within sports analytics, from data engineers to analysts, and highlights the importance of finding one's niche within these roles, particularly in the context of elite basketball. Seth also shares his personal journey into basketball analytics, offering valuable insights and advice for those interested in pursuing a career in this field, stressing the importance of introspection and understanding the unique lifestyle associated with working for a sports team, while also offering industry-agnostic advice on how to approach analyzing and using data in any context.

Oftentimes, Kaggle competitions are looked at as an excellent way for data scientists to sharpen their machine learning skills and become technically excellent. This begs the question, what are the hallmarks of high-performing Kaggle competitors? What makes a Kaggle Grand Master? Today’s guest, Jean-Francois Puget PhD, distinguished engineer at NVIDIA, has achieved this impressive feat three times.  Throughout the episode, Richie and Jean-Francois discuss his background and how he became a Kaggle Grandmaster. He shares his scientific approach to machine learning and how he uses this to consistently achieve high results in Kaggle competitions. Jean-Francois also discusses how NVIDIA employs nine Kaggle Grandmasters and how they use Kaggle experiments to breed innovation in solving their machine learning challenges. He expands on the toolkit he employs in solving Kaggle competitions, and how he has achieved 50X improvements in efficiencies using tools like RAPIDS.  Richie and Jean-Francois also delve into the difference between competitive data science on Kaggle and machine learning work in a real-world setting. They deep dive into the challenges of real-world machine learning, and how to resolve the ambiguities of using machine learning in production that data scientists don’t encounter in Kaggle competitions.