GenAI applications and Copilots are transforming the SQL experience. Join us to learn how Microsoft delivers an optimal platform for new AI workloads using vectors and RAG patterns, while ensuring ROI, performance, and security your business demands today. Discover the latest innovations for Azure SQL for gen AI applications and database context-aware Copilots, powered by Azure SQL Database Hyperscale. Ensure your SQL estate is future-ready in this era of intelligent applications and analytics.

𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀: * John Tracy * Bob Ward * Muazma Zahid

𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Ignite 2024 event. View even more sessions on-demand and learn about Microsoft Ignite at https://ignite.microsoft.com

BRK192 | English (US) | Data

MSIgnite

In this session for AI devs (or those just getting started), you'll get a quick primer on RAG (Retrieval-Augmented-Generation) fundamentals, then learn how to use LlamaIndex and Azure AI Search to rapidly build, test, and evaluate Advanced RAG applications. Join us for practical information on RAG, popular retrieval strategies and setting up your first data-grounded AI application.

𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀: * Farzad Sunavala * Laurie Voss

𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Ignite 2024 event. View even more sessions on-demand and learn about Microsoft Ignite at https://ignite.microsoft.com

BRK106 | English (US) | AI

MSIgnite

Azure AI Search is a full-featured knowledge retrieval system, built to power enterprise-ready RAG applications. Join this session to learn about our latest announcements and our continuous momentum for delivering trend-setting search, superior retrieval quality and enabling RAG at scale.

𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀: * Pablo Castro

𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Ignite 2024 event. View even more sessions on-demand and learn about Microsoft Ignite at https://ignite.microsoft.com

BRK105 | English (US) | AI

MSIgnite

What does RAG at scale look like? When building your own copilot, how do you know your application is delivering the responses as designed? Join our session with AT&T, where Mark will share how they built a RAG knowledge management platform on Azure AI Search, powering hundreds of GenAI applications across the organization. We will show how RAG quality is measured, and the variety of use cases built on top of this RAG platform. See what RAG at scale truly looks like in production.

𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀: * Mark Austin * Ben Tezcan

𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Ignite 2024 event. View even more sessions on-demand and learn about Microsoft Ignite at https://ignite.microsoft.com

BRK104 | English (US) | AI

MSIgnite

Large language models (LLMs) are revolutionizing the world, promising to automate tasks and solve complex problems. A new generation of software applications are using these models as building blocks to unlock new potential in almost every domain, but reliably accessing these capabilities requires new skills. This book will teach you the art and science of prompt engineering-the key to unlocking the true potential of LLMs. Industry experts John Berryman and Albert Ziegler share how to communicate effectively with AI, transforming your ideas into a language model-friendly format. By learning both the philosophical foundation and practical techniques, you'll be equipped with the knowledge and confidence to build the next generation of LLM-powered applications. Understand LLM architecture and learn how to best interact with it Design a complete prompt-crafting strategy for an application Gather, triage, and present context elements to make an efficient prompt Master specific prompt-crafting techniques like few-shot learning, chain-of-thought prompting, and RAG

Search quality is the most important factor defining user experience in Retrieval Augmented Generation (RAG) systems. This session will explore how hybrid vector search and optimized embeddings are crucial for productionizing this technology and significantly improving search quality.

Crispin Velez Villazon discusses agents and RAG in production.

The success of GenAI apps is decided by the accuracy of their responses. Using Retrieval Augmented Generation (RAG), you can improve accuracy by grounding GenAI app responses in your data. In this session, explore advanced RAG techniques in Azure Database for PostgreSQL including new vector search algorithms, parameter tuning, hybrid search, semantic ranking, and the GraphRAG approach. See how customers are using these techniques to deploy corporate development platform for GenAI apps.

𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀: * Maxim Lukiyanov * Orhun Oezbek * Jay Yang

𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Ignite 2024 event. View even more sessions on-demand and learn about Microsoft Ignite at https://ignite.microsoft.com

BRK190 | English (US) | Data

MSIgnite

Episode Notes: Overview In this compelling episode, I dive into the cutting-edge world of Neuro Symbolic AI, a transformative approach to business strategy that goes beyond traditional SWOT analysis. Moving past the capabilities of older models like GPT-3.5, this episode introduces a tool that doesn’t just identify strengths, weaknesses, opportunities, and threats but also explains the deeper implications and potential future outcomes of each. Join me as I explore how Neuro Symbolic AI is setting new standards for strategic analysis. Key Topics Covered Rebranding the Show I open by explaining the recent rebranding to focus entirely on data and AI, setting the stage for a deeper, more specialized dive into AI-driven insights.Introduction to SWOT Analysis Discover the basics of SWOT analysis and its applications in evaluating businesses, projects, and even personal goals. I explore how traditional AI tools, like GPT-3.5, offer simple, list-based insights but often lack depth and context.The Limitations of Traditional AI I discuss how traditional AI, though powerful, can be too simplistic. It provides a list of strengths and weaknesses without fully explaining their significance or forecasting potential impacts. This often leaves critical details overlooked.Neuro Symbolic AI: The Next Evolution Here, I introduce Neuro Symbolic AI, a hybrid model that combines pattern recognition with rule-based logic. This allows it to not only identify key traits but also to explain why they matter and how they could influence future outcomes. Neuro Symbolic AI transforms SWOT analysis from a static list into a dynamic, predictive tool for strategic planning.Real-World Applications and Advantages Using the example of a fictional toy company, I demonstrate how Neuro Symbolic AI can reveal deeper insights and future opportunities or challenges that traditional AI might miss. This tool doesn’t just give a list—it explains how each factor contributes to the company’s overall strategy and growth potential.The Future of Strategic AI I wrap up by discussing the potential of Neuro Symbolic AI to revolutionize strategic analysis across industries. This AI model can anticipate market shifts, rank strategic priorities, and offer actionable insights, making it an invaluable asset for forward-thinking businesses.Why Listen? If you’re interested in the latest advancements in AI or seeking smarter, future-oriented approaches to business strategy, this episode is a must-listen. Neuro Symbolic AI represents a breakthrough in predictive analysis, providing the kind of context and foresight that can turn reactive strategies into proactive ones.

Additional Links: 1] Neurosymbolic AI vs. Traditional AI Blog Post 2] FREEBIES: Sign up for my substack newsletter (https://mukundansankar.substack.com) and get: free RAG cheatsheet, and wait for it... a FREE Neuro-symbolic AI Cheatsheet! 3] AI for SWOT Analysis Blog Post: https://shorturl.at/RJ9fA

Legacy App as Context (RAG with a Graph Database)

Episode Summary: In this episode, I delve into Google’s NotebookLM, an advanced AI-powered tool designed for research, note-taking, and audio content generation. Originally adopted by content creators for podcasting, NotebookLM offers a range of possibilities beyond mere podcast generation, including making complex ideas easily understandable and serving as an educational tool. Key Discussion Points: Introduction to NotebookLM: NotebookLM, powered by Google’s Gemini 1.5, is a unique AI tool designed to convert written content into natural-sounding audio conversations. I highlight its key features, including support for uploading diverse content sources like web links, YouTube videos, and Google Docs.Functionality and User Experience: I share my firsthand experience with NotebookLM, demonstrating how it transformed a complex blog on retrieval-augmented generation into a conversational podcast format. This feature not only simplifies complex topics but makes learning more accessible and engaging.NotebookLM for Education and Supplemental Learning: I advocate for NotebookLM’s potential as a supplemental learning tool. By breaking down intricate topics, it can serve as an aid for understanding research papers, technical blogs, or any complex written material.Vision for the Future: While the tool’s podcasting capabilities are a game-changer, I envision NotebookLM’s greater impact on education and personal development. I discuss the potential of NotebookLM as a go-to resource for learning on the move, from research papers to blog posts.Takeaway Tips: Use NotebookLM to generate personalized audio content from educational materials.Transform complex topics into digestible audio formats for on-the-go learning.Experiment with NotebookLM as a supplement to traditional learning tools like YouTube or Google Search.Closing Thoughts: I emphasize the potential of NotebookLM as an educational revolution in AI, urging listeners to explore its capabilities and unlock a new way of learning complex topics easily. Additional Resources: Blog Post I used to convert to podcast using NotebookLMTune in to experience NotebookLM’s ability to make complex topics accessible and engaging, and hear my take on its potential future applications!

Send us a text Welcome to the cozy corner of the tech world where ones and zeros mingle with casual chit-chat. Datatopics Unplugged  is your go-to spot for relaxed discussions around tech, news, data, and society. Dive into conversations that should flow as smoothly as your morning coffee (but don't), where industry insights meet laid-back banter. Whether you're a data aficionado or just someone curious about the digital age, pull up a chair, relax, and let's get into the heart of data, unplugged style! In this episode, we cover: ChatGPT Search: Exploring OpenAI's new web-browsing capability, and how it transforms everything from everyday searches to complex problem-solving.ChatGPT is a Good Rubber Duck: Discover how ChatGPT makes for an excellent companion for debugging and brainstorming, offering more than a few laughs along the way.What’s New in Python 3.13: From the new free-threaded mode to the just-in-time (JIT) compiler, we break down the major (and some lesser-known) changes, with additional context from this breakdown and Reddit insights.UV is Fast on its Feet: How the development of new tools impacts the Python packaging ecosystem, with a side discussion on Poetry and the complexities of Python lockfiles.Meta’s Llama Training Takes Center Stage: Meta ramps up its AI game, pouring vast resources into training the Llama model. We ponder the long-term impact and their ambitions in the AI space.OpenAI’s Swarm: A new experimental framework for multi-agent orchestration, enabling AI agents to collaborate and complete tasks—what it means for the future of AI interactions.PGrag for Retrieval-Augmented Generation (RAG): We explore Neon's integration for building end-to-end RAG pipelines directly in Postgres, bridging vector databases, text embedding, and more.OSI’s Open Source AI License: The Open Source Initiative releases an AI-specific license to bring much-needed clarity and standards to open-source models.We also venture into generative AI, the future of AR (including Apple Vision and potential contact lenses), and a brief look at V0 by Vercel, a tool that auto-generates web components with AI prompts.

In this episode of The Deep Dive, we explore Retrieval-Augmented Generation, or RAG, and its revolutionary impact on AI. We break down five game-changing applications of RAG, each transforming how AI interacts with real-time data and complex information. Discover how RAG is enhancing everything from customer service to academic research, by tackling challenges like outdated information and static AI models. Key Highlights: Real-time Q&A Systems: How RAG ensures that AI provides the most up-to-date answers, making customer support smarter and more reliable.Dynamic Content Creation: No more stale reports—learn how RAG allows for content that updates in real-time.Multi-Source Summarization: Summarizing complex, often conflicting information from multiple sources for balanced insights.Intelligent Chatbots: Discover how RAG-driven chatbots bring up-to-the-minute responses, improving user experience in real-time.Specialized Knowledge Integration: From medical diagnoses to legal precedents, see how RAG is revolutionizing fields requiring precise, specialized knowledge.Tune in to see how RAG is shaping the future of AI, making it more adaptable, intelligent, and responsive to our world’s ever-changing landscape! Resources: Article: "5 Game-Changing Techniques to Boost Your NLP Projects with Retrieval Augmented Generation"Explore hands-on with RAG at Hugging FaceResearch and community forums for deeper learning and discussions on RAG

Applying RAG (Retrieval-Augmented Generation) to financial data using knowledge graphs.

The "LLM Engineer's Handbook" is your comprehensive guide to mastering Large Language Models from concept to deployment. Written by leading experts, it combines theoretical foundations with practical examples to help you build, refine, and deploy LLM-powered solutions that solve real-world problems effectively and efficiently. What this Book will help me do Understand the principles and approaches for training and fine-tuning Large Language Models (LLMs). Apply MLOps practices to design, deploy, and monitor your LLM applications effectively. Implement advanced techniques such as retrieval-augmented generation (RAG) and preference alignment. Optimize inference for high performance, addressing low-latency and high availability for production systems. Develop robust data pipelines and scalable architectures for building modular LLM systems. Author(s) Paul Iusztin and Maxime Labonne are experienced AI professionals specializing in natural language processing and machine learning. With years of industry and academic experience, they are dedicated to making complex AI concepts accessible and actionable. Their collaborative authorship ensures a blend of theoretical rigor and practical insights tailored for modern AI practitioners. Who is it for? This book is tailored for AI engineers, NLP professionals, and LLM practitioners who wish to deepen their understanding of Large Language Models. Ideal readers possess some familiarity with Python, AWS, and general AI concepts. If you aim to apply LLMs to real-world scenarios or enhance your expertise in AI-driven systems, this handbook is designed for you.

In this tutorial, we describe and show every step in building your own local RAG application using Milvus, LangChain, Ollama and Llama 3.x. At the end of the talk, you will have a working RAG application. We will also cover tips and techniques to upgrade to more advanced RAG apps.

Dive into the world of vector databases and Retrieval Augmented Generation (RAG) as we explore how we built a practical application and the challenges we faced. Discover how semantic search can enrich data, enabling recommendation engines, fraud detection, and more. Learn how these technologies can fit into your current applications and data, sparking new ideas for innovation.

AI is transforming data development and engagement at ClickUp. By working to integrate AI at every stage—from data ingestion and transformation and even down to customer-facing systems—ClickUp is at the forefront. A key component of this initiative is a multi-step process to implement a Retrieval Augmented Generation (RAG) system. This involves several strategic steps, including an AI-integrated IDE for development and an in-house application designed to offer unique insights into the data stack, fully aligned with business operations. This approach simplifies information retrieval and streamlines processes for internal data teams and stakeholders. Join us to explore ClickUp’s approach to AI development and discover the benefits of AI in the data industry.

Speaker: Collin Lenon Senior Analytics Engineer ClickUp

Read the blog to learn about the latest dbt Cloud features announced at Coalesce, designed to help organizations embrace analytics best practices at scale https://www.getdbt.com/blog/coalesce-2024-product-announcements

This book is your comprehensive guide to building robust Generative AI solutions using the Databricks Data Intelligence Platform. Databricks is the fastest-growing data platform offering unified analytics and AI capabilities within a single governance framework, enabling organizations to streamline their data processing workflows, from ingestion to visualization. Additionally, Databricks provides features to train a high-quality large language model (LLM), whether you are looking for Retrieval-Augmented Generation (RAG) or fine-tuning. Databricks offers a scalable and efficient solution for processing large volumes of both structured and unstructured data, facilitating advanced analytics, machine learning, and real-time processing. In today's GenAI world, Databricks plays a crucial role in empowering organizations to extract value from their data effectively, driving innovation and gaining a competitive edge in the digital age. This book will not only help you master the Data Intelligence Platform but also help power your enterprise to the next level with a bespoke LLM unique to your organization. Beginning with foundational principles, the book starts with a platform overview and explores features and best practices for ingestion, transformation, and storage with Delta Lake. Advanced topics include leveraging Databricks SQL for querying and visualizing large datasets, ensuring data governance and security with Unity Catalog, and deploying machine learning and LLMs using Databricks MLflow for GenAI. Through practical examples, insights, and best practices, this book equips solution architects and data engineers with the knowledge to design and implement scalable data solutions, making it an indispensable resource for modern enterprises. Whether you are new to Databricks and trying to learn a new platform, a seasoned practitioner building data pipelines, data science models, or GenAI applications, or even an executive who wants to communicate the value of Databricks to customers, this book is for you. With its extensive feature and best practice deep dives, it also serves as an excellent reference guide if you are preparing for Databricks certification exams. What You Will Learn Foundational principles of Lakehouse architecture Key features including Unity Catalog, Databricks SQL (DBSQL), and Delta Live Tables Databricks Intelligence Platform and key functionalities Building and deploying GenAI Applications from data ingestion to model serving Databricks pricing, platform security, DBRX, and many more topics Who This Book Is For Solution architects, data engineers, data scientists, Databricks practitioners, and anyone who wants to deploy their Gen AI solutions with the Data Intelligence Platform. This is also a handbook for senior execs who need to communicate the value of Databricks to customers. People who are new to the Databricks Platform and want comprehensive insights will find the book accessible.