talk-data.com talk-data.com

Topic

SQL

Structured Query Language (SQL)

database_language data_manipulation data_definition programming_language

241

tagged

Activity Trend

107 peak/qtr
2020-Q1 2026-Q1

Activities

241 activities · Newest first

Extending SQL Databases with Python

What if your database could run Python code inside SQL? In this talk, we’ll explore how to extend popular databases using Python, without needing to write a line of C.

We’ll cover three systems—SQLite, DuckDB, and PostgreSQL—and show how Python can be used in each to build custom SQL functions, accelerate data workflows, and prototype analytical logic. Each database offers a unique integration path: - SQLite and DuckDB allow you to register Python functions directly into SQL via sqlite3.create_function, making it easy to inject business logic or custom transformations. - PostgreSQL offers PL/Python, a full-featured procedural language for writing SQL functions in Python. We’ll also touch on advanced use cases, including embedding the Python interpreter directly into a PostgreSQL extension for deeper integration.

By the end of this talk, you’ll understand the capabilities, limitations, and gotchas of Python-powered extensions in each system—and how to choose the right tool depending on your use case, whether you’re analyzing data, building pipelines, or hacking on your own database.

From Notebook to Pipeline: Hands-On Data Engineering with Python

In this hands-on tutorial, you'll go from a blank notebook to a fully orchestrated data pipeline built entirely in Python, all in under 90 minutes. You'll learn how to design and deploy end-to-end data pipelines using familiar notebook environments, using Python for your data loading, data transformations, and insights delivery.

We'll dive into the Ingestion-Tranformation-Delivery (ITD) framework for building data pipelines: ingest raw data from cloud object storage, transform the data using Python DataFrames, and deliver insights via a Streamlit application.

Basic familiarity with Python (and/or SQL) is helpful, but not required. By the end of the session, you'll understand practical data engineering patterns and leave with reusable code templates to help you build, orchestrate, and deploy data pipelines from notebook environments.

AWS re:Invent 2025 - Cut costs & operate efficiently on Amazon RDS for SQL Server & Oracle (DAT325)

Discover how leading enterprises are leveraging 15+ years of Amazon RDS operational excellence to power their SQL Server and Oracle databases in the cloud. In this session, explore features across Amazon RDS for SQL Server and Oracle that help you achieve substantial cost savings, enhanced scalability, and efficient operations. Through real-world cost optimization techniques and architectural best practices, learn how organizations are reducing operational overhead and costs while improving availability, scalability, and performance.

Learn more: More AWS events: https://go.aws/3kss9CP

Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4

ABOUT AWS: Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

AWSreInvent #AWSreInvent2025 #AWS

AWS re:Invent 2025 - Accelerating data engineering with AI Agents for AWS Analytics (ANT215)

Data engineers face critical time sinks: writing code to build analytics pipelines from scratch and upgrading Apache Spark versions. In this lightning talk, discover how AWS is addressing both challenges with AI agents that accelerate development cycles. Learn how the Amazon SageMaker Data Agent transforms natural language instructions into executable SQL and Python code within SageMaker notebooks, maintaining full context awareness of your data sources and schemas. Then explore the Apache Spark upgrade agent, which accelerates complex multi-month upgrade projects into week-long initiatives through automated code analysis and transformation. Walk away understanding how these agents work to automate manual work from your data engineering workflows, whether you're building new applications or modernizing existing ones.

Learn more: More AWS events: https://go.aws/3kss9CP

Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4

ABOUT AWS: Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

AWSreInvent #AWSreInvent2025 #AWS

AWS re:Invent 2025 - Deep dive into Amazon Aurora DSQL and its architecture (DAT439)

Amazon Aurora DSQL is a serverless, distributed SQL database that uses decades of Amazon innovation and operational excellence. Join this session to dive into the design and key innovative technologies that make Aurora DSQL the ideal choice for new applications and applications which require the highest level of resilience. Learn how active-active architecture in Aurora DSQL delivers single- and multi-Region resiliency and virtually unlimited scale.

Learn more: More AWS events: https://go.aws/3kss9CP

Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4

ABOUT AWS: Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

AWSreInvent #AWSreInvent2025 #AWS

AWS re:Invent 2025 - What's new in Amazon Redshift and Amazon Athena (ANT206)

Learn how AWS is enhancing its SQL analytics offerings with new capabilities in Amazon Redshift and Amazon Athena. Discover how Redshift's AI-powered data warehousing capabilities are enabling customers to modernize their analytics workloads with enhanced performance and cost optimization. Explore Athena's latest features for interactively querying data directly in their Amazon S3 data lakes. This session showcases new features and real-world examples of how organizations are using these services to accelerate business insights while optimizing costs.

Learn more: More AWS events: https://go.aws/3kss9CP

Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4

ABOUT AWS: Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

AWSreInvent #AWSreInvent2025 #AWS

AWS re:Invent 2025 - Unified knowledge access: Bridging data with generative AI agents  (AIM338)

As organizations mature their generative AI strategy, more complex use cases emerge. Originally focused on unstructured data, organizations now require structured data as a source of knowledge for AI applications. This session will showcase a method for storing and accessing structured and unstructured data in tandem through an AI agent. Learn how to put text data into a vector store and create a text-to-SQL system with advanced knowledge bases, then efficiently direct user questions using AI agents for a smooth user experience. This approach demonstrates how to leverage both structured and unstructured data sources to enhance the capabilities of generative AI systems in enterprise environments.

Learn more: More AWS events: https://go.aws/3kss9CP

Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4

ABOUT AWS: Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

AWSreInvent #AWSreInvent2025 #AWS

AWS re:Invent 2025 - Universal data connectivity with ETL and SQL queries (ANT209)

Learn how AWS can help you with data integration and preparing data for analytics, machine learning (ML) and generative AI workloads. Explore new capabilities that enable your users to have controlled access to all relevant data, easily build and maintain scalable and resilient data pipelines, and enhance decision-making quality,all with exceptional price performance. See how zero-ETL and query federation can complement ETL and ELT data pipelines.

Learn more: More AWS events: https://go.aws/3kss9CP

Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4

ABOUT AWS: Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

AWSreInvent #AWSreInvent2025 #AWS

AWS re:Invent 2025 - PostgreSQL performance: Real-world workload tuning (DAT410)

PostgreSQL performance isn’t magic—it’s engineering. In this code talk, we dive deep into practical tuning techniques to avoid common pitfalls that silently degrade performance by improving an underperforming PostgreSQL database workload. Learn how excessive indexes hurt write throughput, why HOT updates fail, and how vacuum behavior can stall your system. We’ll demonstrate how to use Query Plan Management (QPM) and pg_hint_plan for plan stability and decode wait events to uncover hidden bottlenecks. With real SQL examples and system insights, this session equips you to tune PostgreSQL for predictable, high-performance workloads.

Learn more: More AWS events: https://go.aws/3kss9CP

Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4

ABOUT AWS: Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts. AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.

AWSreInvent #AWSreInvent2025 #AWS

Sam’s Club transforms retail mission-critical apps with Azure

Learn practical strategies from Sam’s Club for modernizing mission-critical apps to Azure. Dive into technical strategies, get hands-on guidance to implement key resilience patterns and how to operationalize them in Azure Kubernetes Service (AKS), Azure SQL, Cosmos DB, and other critical Azure services. By the end of this session, developers and cloud practitioners will walk away with tools to modernize legacy monolithic apps for resilience, performance, and scale in Azure.

How Levi’s is transforming their IT estate with Azure

Join us to hear how Levi’s transformed its global IT estate—including Windows Server, SQL Server, SAP, Oracle, and more—through a comprehensive migration and modernization strategy. Learn how they combined data and app modernization with infrastructure re-platforming to unlock agility, scalability, and cost savings. This real-world story will highlight the strategy, lessons learned, and tangible business outcomes that came from taking an end-to-end approach to migration and modernization.

SQL database in Fabric: The unified database for AI apps and analytics

Discover how SQL in Fabric brings transactional and analytical workloads together in one cloud-native database. In this session, we’ll show how developers and data teams can simplify AI-driven application development with near real-time insights and built-in AI, seamless OneLake integration, and end-to-end analytics—all in a single, unified experience.

Meet the performance-enhanced next gen Azure SQL Managed Instance

Get 2X performance and 5X database capacity with Azure SQL Managed Instance. The new next-gen General Purpose tier sets a new standard of value for fully managed SQL solutions. Get started quickly with AI-assisted tooling that can complete an end-to-end migration in days. See this come to life with insurance services organization, Hexure who rebuilt their platform with Azure SQL Managed Instance and Azure App Service and delivered a better CX in one highly performant, scalable and efficient platform.

Build scalable AI apps with Azure SQL Database Hyperscale
breakout
by Ravi Mantena , Anna Hoffman (Azure Data) , Ross Jenkins (Hexagon ALI / Octave) , Aditya Badramraju (Microsoft) , Britt Ewen (BlackRock) , Dmitry Borodin (Hexagon Asset Lifecycle Intelligence)

Build AI apps that run securely and scale with your needs with Azure SQL Database Hyperscale. We’ll cover native vector indexes for semantic search, read scale out for low latency RAG, and secure model invocation with Microsoft Foundry, using the model of your choice, from T SQL. Hear directly from global technology company Hexagon and investment firm BlackRock who will join us to share their experience along with best practices, demos and more!

SQL Server 2025: The AI-ready enterprise database

SQL Server 2025 redefines what's possible for the enterprise data platform. With developer-first features and seamless integration with analytics and AI models, SQL Server 2025 accelerates AI innovation using the data you already own. Build modern apps with native JSON and REST APIs and harness AI with built-in vector search. Increase application availability with optimized locking and use Fabric mirroring for near real-time analytics. Join us to see why this is the most advanced SQL Server.

Use Azure Migrate for AI assisted insights and cloud transformation

Discover how you can make the most of your IT estate migrations and modernizations with the newest AI capabilities. This session guides IT teams through assessing current environments, setting goals, and creating a business case with Azure Migrate for all of your workload types like Windows Server, SQL Server, .NET, Linux, PostgreSQL, Java, and more. We’ll explore tools to inventory workloads, map dependencies, and create actionable migration roadmaps.

Innovation Session: Microsoft Fabric and Azure Databases - the data estate for AI

In today’s AI-driven economy, data isn’t just an asset, it’s your differentiator. Join us for major announcements across Microsoft Fabric, Power BI, Azure SQL, and Azure PostgreSQL, and see how these innovations come together to deliver a unified, intelligent data foundation for AI. Experience customer success stories, live demos, and an inside look at the roadmap shaping the future of analytics, transactional workloads, and real-time insights all in one integrated experience.

Modern data, modern apps: Innovation with Microsoft Databases

Whether you’re modernizing for peak performance and AI readiness or building the next generation of intelligent apps and agents, the Microsoft database portfolio fuels your vision. Join CVP Shireesh Thota for an inside look at the latest innovations across SQL, NoSQL, and open-source databases—featuring dynamic demos that reveal how to boost productivity, deliver rich, personalized experiences, and unlock new possibilities from your data.

Zero-footprint SQL testing: From framework to culture shift

We built a zero-footprint SQL testing framework using mock data and the full power of the pytest ecosystem to catch syntactic and semantic issues before they reach production. More than just a tool, it helped shift our team’s mindset by integrating into CI/CD, encouraging contract-driven development, and promoting testable SQL. In this session, we’ll share our journey, key lessons learned, and how we open-sourced the framework to make it available for everyone.