Learn how to build a cost-efficient AI infrastructure with GKE and Cloud TPU to train large-scale generative AI models.

Click the blue “Learn more” button above to tap into special offers designed to help you implement what you are learning at Google Cloud Next 25.

Matt Turck has been publishing his ecosystem map since 2012. It was first called the Big Data Landscape. Now it's the Machine Learning, AI & Data (MAD) Landscape.  The 2024 MAD Landscape includes 2,011(!) logos, which Matt attributes first a data infrastructure cycle and now an ML/AI cycle. As Matt writes, "Those two waves are intimately related. A core idea of the MAD Landscape every year has been to show the symbiotic relationship between data infrastructure, analytics/BI,  ML/AI, and applications." Matt and Tristan discuss themes in Matt's post: generative AI's impact on data analytics, the modern AI stack compared to the modern data stack, and Databricks vs. Snowflake (plus Microsoft Fabric). For full show notes and to read 7+ years of back issues of the podcast's companion newsletter, head to https://roundup.getdbt.com. The Analytics Engineering Podcast is sponsored by dbt Labs.

Kishore Aradhya and I both teach, and we agree this is a very difficult landscape to determine what and how to teach. Against the backdrop of generative AI, we discuss the role of universities in teaching tech and data, the role of a teacher, how to teach data, and much more.

DSPY - https://github.com/stanfordnlp/dspy

Send us a text Welcome to the cozy corner of the tech world where ones and zeros mingle with casual chit-chat. Datatopics Unplugged is your go-to spot for relaxed discussions around tech, news, data, and society. Dive into conversations that should flow as smoothly as your morning coffee (but don't), where industry insights meet laid-back banter. Whether you're a data aficionado or just someone curious about the digital age, pull up a chair, relax, and let's explore the complex intersections of data, unplugged style! In episode #43, titled "The Privacy Paradox - The Tug of War Between Data Privacy and Safety," our special guest Sofie Van Den Eynden guides us through a labyrinth of data privacy issues that challenge our notions of security, consent, and progress. The DNA Privacy Conundrum: Sofie Van Den Eynden unravels the tensions between the incredible potential of DNA for solving crimes (inspired from Sofie Claerhout's research and historic cases like the Golden State Killer), and the ensuing privacy concerns, exemplified by the 23andMe data breach and the broad implications of such incidents.Privacy on the Road: A deep dive into the ethical implications of employing smart cameras for road safety and the debate on privacy trade-offs, with a glance at policies in Germany and the Netherlands.The Cost of Cyber Safety: How much privacy are we willing to sacrifice for safety? Debating the cost of privacy in the fight against cybercrime. Should transaction data be more accessible to prevent fraud?GenAI and Copyright : We cap off the episode with a discussion on copyright issues in the age of AI, ignited by Kid Rock's interview with Theo Von. 

Are LLMs useful for enterprises? Well, what is the use of a large language model that is trained on trillions of tokens but knows little to nothing about your business.

To make LLMs actually useful for enterprises, it is important for them to retrieve company's data effectively. LlamaIndex has been at the forefront of providing such solutions and frameworks to augment LLMs.

In this episode, Jerry Liu, Co-founder and CEO of LlamaIndex, joins Raja Iqbal, CEO and Chief Data Scientist at Data Science Dojo, for a deep dive into the intersection of generative AI, data. and entrepreneurship.

Jerry walks us through the cutting-edge technologies reshaping the generative AI landscape such as LlamaIndex. He also explores Retrieval Augmented Generation (RAG) and fine-tuning in detail, discussing their benefits, trade-offs, use cases, and enterprise adoption, making these complex tools and topics not just easily understandable but also fascinating.

Jerry further ventures into the heart of entrepreneurship, sharing valuable lessons and insights learned along his journey, from navigating his corporate career at tech giants like Apple, Quora, Two Sigma, and Uber, to starting as a founder in the data and AI landscape.

Amidst the excitement of innovation, Raja and Jerry also address the potential risks and considerations with generative AI. They raise thought-provoking questions about its impact on society, for instance, whether we're trading critical thinking for convenience.

Whether you're a generative AI enthusiast, seasoned entrepreneur, or simply curious about the future, this podcast promises plenty of knowledge and insights for you.

Everyone has seen the reach and impact of generative AI, and with countless use-cases across a variety of fields, the question is often not "can we do things with AI?", but rather "what should we do with AI?". What are the key areas where generative AI has had a profound impact already? Which economies, industries, and businesses have taken full advantage of the abilities of GenAI already? It takes a lot of wisdom and experience within the data & AI space to distill high-level insights from such a rapidly changing world, but, luckily we have one of the best people in the world to quiz on the current landscape and future of AI.  Bernard Marr is an internationally best-selling business author, keynote speaker and strategic advisor to companies and governments. He advises many of the world’s best-known organizations such as Amazon, Google, Microsoft, IBM, Toyota, and more. LinkedIn has recently ranked Bernard as one of the top 5 business influencers in the world. He has authored 19 best-selling books, including his new book Generative AI in Practice: 100+ Amazing Ways Generative Artificial Intelligence is Changing Business and Society. Every day Bernard actively engages his over 4 million social media followers. He is one of the world’s most highly respected experts when it comes to future trends, strategy, business performance, digital transformation and the intelligent use of data and AI in business. In the episode, Richie and Bernard explore how AI will impact society through the augmentation of jobs, the importance of developing skills that won’t be easily replaced by AI, how generative AI is revolutionizing creative fields already, how AI will impact education, AI’s role in coding and software development, use cases of generative AI in business, how personalization is set to improve through AI, concerns and ethical considerations surrounding AI, why we should be optimistic about the future of AI, and much more.  Links Mentioned in the Show: Bernard’s book: Generative AI in PracticeBernard’s Website, Twitter and Linkedin[Skill Track] AI Business FundamentalsRelated Episode: Adapting to the AI Era with Jason Feifer, Editor in Chief of Entrepreneur Magazine New to DataCamp? Learn on the go using the DataCamp mobile appEmpower your business with world-class data and AI skills with DataCamp for business

Matthew Lynley is a bit of a hybrid. He's been a long-time journalist covering enterprise tech, currently in his fantastic AI and data newsletter Supervised, and he's also been a hands-on data practitioner.  Matthew has covered the analytics tech stack, but this time Tristan turns the tables to get Matthew's perspective on the rise of Gen AI as a topic in the popular press, what's going on in the space today, and where AI is headed. For full show notes and to read 6+ years of back issues of the podcast's companion newsletter, head to https://roundup.getdbt.com. The Analytics Engineering Podcast is sponsored by dbt Labs.

Discover how master data management (MDM) provides language models with high-quality enterprise data to improve their response accuracy. Published at: https://www.eckerson.com/articles/improving-genai-accuracy-with-master-data-management

Generative AI has made a mark everywhere, including BI platforms, but how can you combine AI and BI together? What effects can this have across organizations? With constituent aspects such as data quality, your AI strategy, and the specific use-case you’re trying to solve, it’s important to get the full picture and tread with intent. What are the subtleties that we need to get right in order for this marriage to work to its full potential? Nick Magnuson is the Head of AI at Qlik, executing the organization’s AI strategy, solution development, and innovation. Prior to Qlik, Nick was the CEO of Big Squid, which was acquired by Qlik in 2021. Nick has previously held executive roles in customer success, product, and engineering in the field of machine learning and predictive analytics. As a practitioner in this field for over 20 years, Nick has published original research in these areas, as well as cognitive bias and other quantitative topics. He has also served as an advisor to other analytics platforms and start-ups. A long-time investment professional, Nick continues to hold his Chartered Financial Analyst designation and is a past member of the Chicago Quantitative Alliance and Society of Quantitative Analysts.  In the episode, Richie and Nick explore what Qlik offers, including products like Sense and Staige, how Staige uses AI to enhance customer capabilities, use cases of generative AI, advice on data privacy and security when using AI, data quality and its effect on the success of AI tools, AI strategy and leadership, how data roles are changing and the emergence of new positions, and much more. 

Links Mentioned in the Show: QlikQlik StaigeQlik Sense[Skill Track] AI FundamentalsRelated Episode: Adapting to the AI Era with Jason Feifer, Editor in Chief of Entrepreneur MagazineSign up to RADAR: The Analytics Edition

New to DataCamp? Learn on the go using the DataCamp mobile app Empower your business with world-class data and AI skills with DataCamp for business

Despite the critical role of analytics in guiding business decisions, organizations continue to face significant challenges in harnessing its full potential. As data sets expand and deadlines shrink, the urgency to scale analytics processes becomes paramount. What data leaders now need to focus on are essential strategies for analytics at scale, including fostering a culture of continuous learning, prioritizing data governance, and leveraging generative AI. Libby Duane Adams is the Chief Advocacy Officer and co-founder of Alteryx. She is responsible for strengthening upskilling and reskilling efforts for Alteryx customers to enable a culture of analytics, scaling the presence of the Alteryx SparkED education program and furthering diversity and inclusion in the workplace. As the former Chief Customer Officer, Libby has helped many Fortune 100 executives to identify and seize market opportunities, outsmart their competitors, and drive more revenue from their current businesses using analytics.  In the episode, Richie and Libby explore the differences between analytics and business intelligence, analytics as a team sport, the importance of speed in analytics, generative AI and its implications in analytics, the role of data quality and governance, Alteryx’s AI platform, data skills as a workplace necessity, using AI to automate documentation and insights, success stories and mistakes within analytics, and much more.  Links Mentioned in the Show: AlteryxAlteryx SparkED Program[Course] Introduction to AlteryxRelated Episode: From Data Literacy to AI Literacy with Cindi Howson, Chief Data Strategy Officer at ThoughtSpotSign up to RADAR: The Analytics Edition New to DataCamp? Learn on the go using the DataCamp mobile appEmpower your business with world-class data and AI skills with DataCamp for business

Generative AI is fantastic but has a major problem: sometimes it "hallucinates", meaning it makes things up. In a business product like a chatbot, this can be disastrous. Vector databases like Pinecone are one of the solutions to mitigating the problem. Vector databases are a key component to any AI application, as well as things like enterprise search and document search. They have become an essential tool for every business, and with the rise in interest in AI in the last couple of years, the space is moving quickly. In this episode, you'll find out how to make use of vector databases, and find out about the latest developments at Pinecone. Elan Dekel is the VP of Product at Pinecone, where he oversees the development of the Pinecone vector database. He was previously Product Lead for Core Data Serving at Google, where he led teams working on the indexing systems to serve data for Google search, YouTube search, and Google Maps. Before that, he was Founder and CEO of Medico, which was acquired by Everyday Health. In the episode, RIchie and Elan explore LLMs, hallucination in generative models, vector databases and the best use-cases for them, semantic search, business applications of vector databases and semantic search, the tech stack for AI applications, cost considerations when investing in AI projects, emerging roles within the AI space, the future of vector databases and AI, and much more.   Links Mentioned in the Show: Pinecone CanopyPinecone ServerlessLlamaIndexLangchain[Code Along] Semantic Search with PineconeRelated Episode: Expanding the Scope of Generative AI in the Enterprise with Bal Heroor, CEO and Principal at MactoresSign up to RADAR: The Analytics Edition New to DataCamp? Learn on the go using the DataCamp mobile appEmpower your business with world-class data and AI skills with DataCamp for business

Explore our four primary criteria for evaluating conversational BI products. Published at: https://www.eckerson.com/articles/genai-driven-analytics-product-evaluation-criteria-for-conversational-bi

In this episode of Experiencing Data, I speak with Ellen Chisa, Partner at BoldStart Ventures, about what she’s seeing in the venture capital space around AI-driven products and companies—particularly with all the new GenAI capabilities that have emerged in the last year. Ellen and I first met when we were both engaged in travel tech startups in Boston over a decade ago, so it was great to get her current perspective being on the “other side” of products and companies working as a VC.  Ellen draws on her experience in product management and design to discuss how AI could democratize software creation and streamline backend coding, design integration, and analytics. We also delve into her work at Dark and the future prospects for developer tools and SaaS platforms. Given Ellen’s background in product management, human-centered design, and now VC, I thought she would have a lot to share—and she did!

Highlights/ Skip to: I introduce the show and my guest, Ellen Chisa (00:00) Ellen discusses her transition from product and design to venture capital with BoldStart Ventures. (01:15) Ellen notes a shift from initial AI prototypes to more refined products, focusing on building and testing with minimal data. (03:22) Ellen mentions BoldStart Ventures' focus on early-stage companies providing developer and data tooling for businesses.  (07:00) Ellen discusses what she learned from her time at Dark and Lola about narrowing target user groups for technology products (11:54) Ellen's Insights into the importance of user experience is in product design and the process venture capitalists endure to make sure it meets user needs (15:50) Ellen gives us her take on the impact of AI on creating new opportunities for data tools and engineering solutions, (20:00) Ellen and I explore the future of user interfaces, and how AI tools could enhance UI/UX for end users. (25:28) Closing remarks and the best way to find Ellen on online (32:07)

Quotes from Today’s Episode “It's a really interesting time in the venture market because on top of the Gen AI wave, we obviously had the macroeconomic shift. And so we've seen a lot of people are saying the companies that come out now are going to be great companies because they're a little bit more capital-constrained from the beginning, typically, and they'll grow more thoughtfully and really be thinking about how do they build an efficient business.”- Ellen Chisa (03: 22) 

“We have this big technological shift around AI-enabled companies, and I think one of the things I’ve seen is, if you think back to a year ago, we saw a lot of early prototyping, and so there were like a couple of use cases that came up again and again.”-Ellen Chisa (3:42)

“I don't think I've heard many pitches from founders who consider themselves data scientists first. We definitely get some from ML engineers and people who think about data architecture, for sure..”- Ellen Chisa (05:06)  

“I still prefer GUI interfaces to voice or text usually, but I think that might be an uncanny valley sort of thing where if you think of people who didn’t have technology growing up, they’re more comfortable with the more human interaction, and then you get, like, a chunk of people who are digital natives who prefer it.”- Ellen Chisa (24:51)

[Citing some excellent Boston-area restaurants!] “The Arc browser just shipped a bunch of new functionality, where instead of opening a bunch of tabs, you can say, “Open the recipe pages for Oleana and Sarma,” and it just opens both of them, and so it’s like multiple search queries at once.” - Ellen Chisa (27:22)

“The AI wave of  technology biases towards people who already have products [in the market] and have existing datasets, and so I think everyone [at tech companies] is getting this big, top-down mandate from their executive team, like, ‘Oh, hey, you have to do something with AI now.’”- Ellen Chisa (28:37)

“I think it’s hard to really grasp what an LLM is until you do a fair amount of experimentation on your own. The experience of asking ChatGPT a simple search question compared to the experience of trying to train it to do something specific for you are quite different experiences. Even beyond that, there’s a tool called superwhisper that I like that you can take audio content and end up with transcripts, but you can give it prompts to change your transcripts as you’re going. So, you can record something, and it will give you a different output if you say you’re recording an email compared to [if] you’re recording a journal entry compared to [if] you’re recording the transcript for a podcast.”- Ellen Chisa (30:11)

Links Boldstart ventures: https://boldstart.vc/ LinkedIn: https://www.linkedin.com/in/ellenchisa/ Personal website: https://ellenchisa.com Email: [email protected] 

Send us a text Welcome to the cozy corner of the tech world where ones and zeros mingle with casual chit-chat. Datatopics Unplugged is your go-to spot for relaxed discussions around tech, news, data, and society. Dive into conversations that should flow as smoothly as your morning coffee (but don't), where industry insights meet laid-back banter. Whether you're a data aficionado or just someone curious about the digital age, pull up a chair, relax, and let's get into the heart of data, unplugged style! In episode #39, titled "Microsoft, Musk, and Extremely Fast Image Gen using SDXL Lightning," we take a spin through the latest tech tremors and thought nuggets. Oh, and don't forget to give a warm welcome to Alex, our enthusiastic intern stepping into the podcast spotlight! Elon Musk's Legal Drama: Musk takes on OpenAI and Sam Altman over a philosophical fallout.Microsoft's Smart Bet: Investing a cool $16M in Mistral AI sparks curiosity.SDXL Lightning Unveiled: A breakthrough in image generation that might just redefine speed.GPT-Script Evolution: The rise of GPT-Script signals a coding renaissance.pkgx Drama: Unwrapping the GenAI layer over OSS packages stirs the pot.Database Dilemma: Questioning the database abundance echoes a common tech gripe.Sticky Table Headings: A plea to make web table headings sticky finds its voice.Intro music courtesy of fesliyanstudios.com.

The success of Generative AI depends on fundamental disciplines like DataOps. Published at: https://www.eckerson.com/articles/dataops-for-generative-ai-data-pipelines-part-i-what-and-why

One of the most immediate needs to come out of the generative AI boom has been the need for guardrails and governmental regulation of AI technologies. Most of the work already completed in the AI space has been industry-led, with large organizations pushing AI forward to improve their efficiency as businesses and to create new avenues for revenue. This focus on industry and revenue can potentially create more inequality in the world, with companies not interested in the negative effects of AI being driven by profit, towards profit. To combat this, the UN has set up an AI Advisory Board, with members from different nationalities, backgrounds and expertises to ensure that AI is for all, and not just for profit. In this episode, we speak to two members of the board.  Ian Bremmer is a political scientist who helps business leaders, policy makers, and the general public make sense of the world around them. He is president and founder of Eurasia Group, the world's leading political risk research and consulting firm, and GZERO Media, a company dedicated to providing intelligent and engaging coverage of international affairs. Ian is credited with bringing the craft of political risk to financial markets, creating Wall Street's first global political risk index (GPRI), and for establishing political risk as an academic discipline. His definition of emerging markets— "those countries where politics matters at least as much as economics for market outcomes”—has become an industry standard. “G-Zero,” his term for a global power vacuum in which no country is willing and able to set the international agenda, is widely used by policymakers and thought leaders. A prolific writer, Ian is the author of eleven books, including two New York Times bestsellers, “Us vs Them: The Failure of Globalism” which examines the rise of populism across the world, and his latest book “The Power of Crisis: How Three Threats—and Our Response—Will Change the World” which details a trio of looming global crises (health emergencies, climate change, and technological revolution) and outlines how governments, corporations, and concerned citizens can use these crises to create global prosperity and opportunity. Jimena Viveros currently serves as the Chief of Staff and Head Legal Advisor to Justice Loretta Ortiz at the Mexican Supreme Court. Her prior roles include national leadership positions at the Federal Judicial Council, the Ministry of Security, and the Ministry of Finance, where she held the position of Director General. Jimena is a lawyer and AI expert, and possesses a broad and diverse international background. She is in the final stages of completing her Doctoral thesis, which focuses on the impact of AI and autonomous weapons on international peace and security law and policy, providing concrete propositions to achieve global governance from diverse legal perspectives. Her extensive work in AI and other legal domains has been widely published and recognized. In the episode, Richie, Ian and Jimena cover what the UN's AI Advisory Body was set up for, the opportunities and risks of AI, how AI impacts global inequality, key principles of AI governance, the implementation of that governance, the future of AI in politics and global society, and much more.  Links Mentioned in the Show: UN Interim Report: Governing AI for HumanityAI for Sustainable Development GoalsThe Power of Crisis: How Three Threats – and Our Response – Will Change the World by Ian Bremmera href="https://www.weforum.org/agenda/2024/01/davos-2024-sam-altman-on-the-future-of-ai/" rel="noopener noreferrer"