Despite $180 billion spent on big data tools and technologies, poor data quality remains a significant barrier for businesses, especially in achieving Generative AI goals. Published at: https://www.eckerson.com/articles/poor-data-quality-is-a-full-blown-crisis-a-2024-customer-insight-report

This blog discusses how GenAI and natural language processing are transforming SQL query generation, allowing non-technical users to access and query data easily. Published at: https://www.eckerson.com/articles/from-4gl-to-genai-how-sql-automation-has-evolved

This blog defines streaming data, explains why companies need it, and explores how streaming data pipelines feed multi-faceted GenAI applications. Published at: https://www.eckerson.com/articles/why-and-how-streaming-data-drives-the-success-of-generative-ai

This blog recommends four questions to help data and AI leaders compare homegrown and commercial options for retrieval augmented generation. Published at: https://www.eckerson.com/articles/build-or-buy-rag-four-questions-to-guide-your-approach-to-retrieval-augmented-generation-for-genai

What will change next year? In the age of generative AI, the answer is simple: Everything! Published at: https://www.eckerson.com/articles/predictions-2025-everything-is-about-to-change

Data analytics is a balance of flexibility for innovation and governance to control risks. This blog discusses its implications for artificial intelligence (AI), including machine learning (ML) and generative AI (GenAI). Published at: https://www.eckerson.com/articles/ai-ml-innovation-requires-a-flexible-yet-governed-data-architecture

Explore the reasons for data engineers to collaborate with data scientists, machine learning (ML) engineers, and developers on DataOps initiatives that support GenAI. Published at: https://www.eckerson.com/articles/dataops-for-generative-ai-data-pipelines-part-iii-team-collaboration

This blog explores three criteria to evaluate tools that manage unstructured data pipelines for GenAI. Published at: https://www.eckerson.com/articles/data-engineering-for-genai-three-criteria-to-evaluate-pipeline-tools

Data engineering is now considered a crucial job in IT as Generative AI, the hottest technology of this decade, relies on data engineers to provide accurate inputs. Published at: https://www.eckerson.com/articles/data-engineering-for-genai-how-to-optimize-data-pipelines-and-governance

Data engineers and data scientists must manage pipelines for unstructured data to ensure healthy inputs for language models. Published at: https://www.eckerson.com/articles/why-and-how-data-engineers-will-enable-the-next-phase-of-generative-ai

Companies that adopt DataOps increase the odds of success by making GenAI data pipelines what they should be: modular, scalable, robust, flexible, and governed. Published: https://www.eckerson.com/articles/dataops-for-generative-ai-data-pipelines-part-ii-must-have-characteristics

GenAI can help data engineers become more productive, and data engineering can help GenAI drive new levels of innovation. Published at: https://www.eckerson.com/articles/achieving-fusion-how-genai-and-data-engineering-help-one-another

Discover how master data management (MDM) provides language models with high-quality enterprise data to improve their response accuracy. Published at: https://www.eckerson.com/articles/improving-genai-accuracy-with-master-data-management

Explore our four primary criteria for evaluating conversational BI products. Published at: https://www.eckerson.com/articles/genai-driven-analytics-product-evaluation-criteria-for-conversational-bi

The success of Generative AI depends on fundamental disciplines like DataOps. Published at: https://www.eckerson.com/articles/dataops-for-generative-ai-data-pipelines-part-i-what-and-why

With the increasing adoption of Generative AI, learn how data governance will add value to and benefit from Generative AI. Published at: https://www.eckerson.com/articles/data-governance-in-the-era-of-generative-ai

It's not easy being the head of data & analytics at a large organization. You must align a large team across multiple disciplines; you must deal with oodles of legacy systems and tools that hamper innovation; and you must deliver business value fast to keep executives at bay and your job intact. You also need to recruit dynamic managers who can push the envelope while meeting operational objectives. And when you falter--which you inevitably will-you have to rebound fast.

No one knows these lessons better than Tiffany Perkins-Munn. She currently runs a 275-person data & analytics team at JP Morgan Chase that consists of data engineers, data scientists, behavioral economists, and business intelligence experts. She thrives on versatility, having earned a Ph.D. in Social-Personality Psychology with an interdisciplinary focus on Advanced Quantitative Methods. Building on this foundation, she has accumulated vast experience in the art of managing data & analytics teams during her 23 years in technical and managerial roles in the financial services industry.

In this interview, you’ll learn:

1. Tiffany’s secret for aligning a large data & analytics team and keep them from splitting into silos of specialization
2. Her favorite techniques for recruiting the right people to her team.
3. How to wade through the thicket of legacy systems and deliver innovative solutions quickly.
4. The impact of GenAI on her operations and the financial services industry.
5. How to advance your careers in data & analytics.

This blog examines the upcoming trend of domain-specific LLMs and evaluates three different methods of implementation. Published at: https://www.eckerson.com/articles/the-next-wave-of-generative-ai-domain-specific-llms

Data leaders must prepare their teams to deliver the timely, accurate, and trustworthy data that GenAI initiatives need to ensure they deliver results. They can do so by modernizing their environments, extending data governance programs, and fostering collaboration with data science teams. Published at: https://www.eckerson.com/articles/the-data-leader-s-guide-to-generative-ai-part-i-models-applications-and-pipelines

Our industry’s breathless hype about generative AI tends to overlook the stubborn challenge of data governance. Data catalogs address this challenge by evaluating and controlling the accuracy, explainability, privacy, IP friendliness, and fairness of GenAI inputs. Published at: https://www.eckerson.com/articles/generative-ai-needs-vigilant-data-cataloging-and-governance

Generative AI initiatives require new data pipelines that prepare text files for querying by language models. Data engineers, scientists, and other stakeholders collaborate to design and implement these pipelines, which span text sources, tokens, vectors, vector databases, and LMs. Published at: https://www.eckerson.com/articles/the-new-data-pipeline-for-generative-ai-where-and-how-it-works

Responsible AI ethical principles provide a clear, unifying purpose for the technological, business, and social goals of AI initiatives. Published at: https://www.eckerson.com/articles/the-opportunity-and-risk-of-generative-ai-part-iii-responsible-ai-ethics

Responsible AI can help data leaders comply with the fast-evolving regulatory environment of data and artificial intelligence. Published at: https://www.eckerson.com/articles/the-opportunity-and-risk-of-generative-ai-part-ii-how-responsible-ai-assists-compliance

US frontier history had races, risks, and rewards. Generative AI's future will follow a similar path. Published at: https://www.eckerson.com/articles/enterprise-data-and-the-taming-of-the-generative-ai-frontier

Generative AI brings a promise to improve lives in a blistering innovation race, but also a threat to people, corporations, and even nations. Data analytics leaders must understand the risks of generative AI, both societal and business-related, to use it positively and avoid the destructive consequences seen with nuclear energy development. Published at: https://www.eckerson.com/articles/the-opportunity-and-risk-of-generative-ai-part-i-a-nuclear-explosion