In the last few years Large Language Models (LLMs) have risen to prominence as outstanding tools capable of transforming businesses. However, bringing such solutions and models to the business-as-usual operations is not an easy task. In this session, we delve into the operationalization of generative AI applications using MLOps principles, leading to the introduction of foundation model operations (FMOps) or LLM operations using Apache Airflow. We further zoom into aspects of expected people and process mindsets, new techniques for model selection and evaluation, data privacy, and model deployment. Additionally, know how you can use the prescriptive features of Apache Airflow to aid your operational journey. Whether you are building using out of the box models (open-source or proprietary), creating new foundation models from scratch, or fine-tuning an existing model, with the structured approaches described you can effectively integrate LLMs into your operations, enhancing efficiency and productivity without causing disruptions in the cloud or on-premises.
talk-data.com
Topic
Cloud Computing
4055
tagged
Activity Trend
Top Events
Cost management is a continuous challenge for our data teams at Astronomer. Understanding the expenses associated with running our workflows is not always straightforward, and identifying which process ran a query causing unexpected usage on a given day can be time-consuming. In this talk, we will showcase an Airflow Plugin and specific DAGs developed and used internally at Astronomer to track and optimize the costs of running DAGs. Our internal tool monitors Snowflake query costs, provides insights, and sends alerts for abnormal usage. With it, Astronomer identified and refactored its most costly DAGs, resulting in an almost 25% reduction in Snowflake spending. We will demonstrate how to track Snowflake-related DAG costs and discuss how the tool can be adapted to any database supporting query tagging like BigQuery, Oracle, and more. This talk will cover the implementation details and show how Airflow users can effectively adopt this tool to monitor and manage their DAG costs.
Cloud availability zones and regions are not immune to outages. These zones regularly go down, and regions become unavailable due to natural disasters or human-caused incidents. Thus, if an availability zone or region goes down, so do your Airflow workflows and applications… unless your Airflow workflows function across multiple geographic locations. This hands-on session introduces you to the design patterns of multi-region Airflow workflows in the cloud, which can tolerate zone and region-level incidents. We will start with a traditional single-region configuration and then switch to a multi-region setting. By the end, we’ll have a working prototype of a multi-region Airflow pipeline that recovers from region-level outages within a few seconds, with no data loss or disruption to the application layer.
On this podcast episode of Data Unchained, we talk with Paul Judkins and Rob Dueckman from Integrated Media Technologies. Paul and Rob join us to discuss the evolution of the Media and Entertainment space, what the current workflow looks like, and cost effective solutions for largerendering projects. Find out more about Integrated Media Technologies by checking out their website: https://imtglobalinc.com/
M&E #media #data #science #podcast #ai #technology #dataexploration #entertainment #rendering #entertainmentnews
@IMTSystemsIntegrator Cyberpunk by jiglr | https://soundcloud.com/jiglrmusic Music promoted by https://www.free-stock-music.com Creative Commons Attribution 3.0 Unported License https://creativecommons.org/licenses/by/3.0/deed.en_US Hosted on Acast. See acast.com/privacy for more information.
This book teaches solutions architects how to effectively design and implement AI/ML solutions utilizing Google Cloud services. Through detailed explanations, examples, and hands-on exercises, you will understand essential AI/ML concepts, tools, and best practices while building advanced applications. What this Book will help me do Build robust AI/ML solutions using Google Cloud tools such as TensorFlow, BigQuery, and Vertex AI. Prepare and process data efficiently for machine learning workloads. Establish and apply an MLOps framework for automating ML model lifecycle management. Implement cutting-edge generative AI solutions using best practices. Address common challenges in AI/ML projects with insights from expert solutions. Author(s) Kieran Kavanagh is a seasoned principal architect with nearly twenty years of experience in the tech industry. He has successfully led teams in designing, planning, and governing enterprise cloud strategies, and his wealth of experience is distilled into the practical approaches and insights in this book. Who is it for? This book is ideal for IT professionals aspiring to design AI/ML solutions, particularly in the role of solutions architects. It assumes a basic knowledge of Python and foundational AI/ML concepts but is suitable for both beginners and seasoned practitioners. If you're looking to deepen your understanding of state-of-the-art AI/ML applications on Google Cloud, this resource will guide you.
Geared to intermediate- to advanced-level DBAs and IT professionals looking to enhance their MySQL skills, this guide provides a comprehensive overview on how to manage and optimize MySQL databases. You'll learn how to create databases and implement backup and recovery, security configurations, high availability, scaling techniques, and performance tuning. Using practical techniques, tips, and real-world examples, authors Arunjith Aravindan and Jeyaram Ayyalusamy show you how to deploy and manage MySQL, Amazon RDS, Amazon Aurora, and Azure MySQL. By the end of the book, you'll have the knowledge and skills necessary to administer, manage, and optimize MySQL databases effectively. Design and implement a scalable and reliable database infrastructure using MySQL 8 on premises and cloud Install and configure software, manage user accounts, and optimize database performance Use backup and recovery strategies, security measures, and high availability solutions Apply best practices for database schema design, indexing strategies, and replication techniques Implement advanced database features and techniques such as replication, clustering, load balancing, and high availability Troubleshoot common issues and errors, using diagnostic tools and techniques to identify and resolve problems quickly and efficiently Facilitate major MySQL upgrades including MySQL 5.7 to MySQL 8
Master class exploring how AI is reshaping IT roles across cloud, data, cybersecurity, and development. Topics include Introduction to AI in IT, How to prompt AI tools for desired results, AI Empowering Developers, Data in the AI Era, and AI for managing Cybersecurity risks.
The 'Tableau Certified Data Analyst Certification Guide' is your essential roadmap to mastering Tableau and excelling in the Tableau Data Analyst certification exam. From fundamentals to advanced techniques, you'll solidify your Tableau skills with clear explanations, practical exercises, and realistic mock exams. After reading, you'll be ready to take the next step in your data analytics career. What this Book will help me do Gain the ability to connect, clean, and transform data effectively using Tableau. Master Tableau's diverse calculation types for data analysis, ranging from basic to advanced. Develop skills to create visually impactful dashboards and data stories. Learn to publish and manage insights on Tableau Cloud for broader collaboration. Acquire the necessary competencies to confidently pass the Tableau Data Analyst certification exam. Author(s) Authors Harry Cooney and Daisy Jones bring a wealth of Tableau and data analytics experience. Harry is a certified Tableau expert with years of teaching and consulting, while Daisy applies her data analysis expertise across industries. Together, they combine practical insights and a supportive approach to guide you through Tableau mastery and certification. Who is it for? This book is ideal for aspiring and practicing data analysts eager to master Tableau. Beginners will appreciate the accessible approach to foundational concepts, while experienced users can deepen their expertise. If you're preparing for the Tableau Certified Data Analyst exam or looking to enhance your visual analytics capabilities, this book is for you.
Join Kirk and Mason Ward, President at 6Fathoms Consulting, for DCR’s 100th Episode! In this episode they dive into the importance of adaptability and individual strengths, transitioning to the data center industry, and the demand for skilled professionals and advocate for education to meet industry needs. Highlighting AI's impact, Kirk and Mason emphasize foundational trades as pathways to leadership. Addressing nuclear power perceptions, they stress bold decision-making and team loyalty for sustainable growth.
Thank you to our Title Sponsor MCIS - Mission Critical Interior Solutions, Inc. provides interior architectural solutions for data, cloud, and mission critical centers across North America. We offer everything from polished, epoxy, and sealed concrete to raised flooring, hot/cold aisle containment, and high-density ceiling grid. We also install raised access flooring in office spaces and provide underfloor air distribution testing to commission spaces - https://mcis-inc.com
For more about us: https://linktr.ee/overwatchmissioncritical
Capella Grundlagen: Einrichten eines Cloud-Accounts; Importieren relationaler Daten und Modellieren in NoSQL; Buckets, Dokumente, Abfragen und Indizes erstellen; Abfragen mit SQL++ (SQL für JSON) schreiben
It can seem like every security company these days is using AI, but many are actually creating more work for security operations by requiring more typing with a chatbot and more reading by analysts to understand what’s occurring. In this lightning talk, learn about Trellix’s different approach—Its virtual analyst makes decisions and has opinions. Explore how it uses AI powered by Amazon Bedrock to decide if findings are among the few that a human should look at. Also, learn how security teams can help ensure every important finding is being evaluated with an in-depth look at how AI makes decisions with the right data. This presentation is brought to you by Trellix, an AWS Partner.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.
reInforce2024 #CloudSecurity #AWS #AmazonWebServices #CloudComputing
Do you have questions about privacy and compliance when it comes to using or building generative AI applications? Join this session for a deep dive on privacy and compliance challenges and considerations that you should be aware of as you embark on your generative AI journey. Gain insights into different generative AI use cases, and learn about what is happening around the world with regard to AI regulation and standards and the impact that they may have on your applications.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.
reInforce2024 #CloudSecurity #AWS #AmazonWebServices #CloudComputing
Join Kirk and Mason Ward, President at 6Fathoms Consulting, for DCR’s 100th Episode! In this episode, they discuss Mason's journey from being an undisciplined student to excelling in the Navy's nuclear program. highlighting the benefits of military training and the valuable skills it instills in you. They explore diverse career paths and commend Mason's innovative approach to success.
Thank you to our Title Sponsor MCIS - Mission Critical Interior Solutions, Inc. provides interior architectural solutions for data, cloud, and mission critical centers across North America. We offer everything from polished, epoxy, and sealed concrete to raised flooring, hot/cold aisle containment, and high-density ceiling grid. We also install raised access flooring in office spaces and provide underfloor air distribution testing to commission spaces - https://mcis-inc.com
For more about us: https://linktr.ee/overwatchmissioncritical
Speaker: Bilal Aslam, Sr. Director of Product Management, Databricks
Bilal explains that everything starts with good data and outlines the three steps to good data including, ingesting, transforming and orchestrating your data. Then Bilal announces Databricks LakeFlow - a unified solution for data engineering. With LakeFlow you can ingest data from databases, enterprise apps and cloud sources, transform it in batch and real-time streaming, and confidently deploy and operate in production. Includes a live demo of Databricks LakeFlow.
To learn more about Databricks LakeFlow, see the announcement blog post: https://www.databricks.com/blog/introducing-databricks-lakeflow
As an increasing number of organizations leverage internal data for optimizing outputs in generative AI through Retrieval Augmented Generation (RAG), concerns about potential internal data leaks have grown. This talk delves into strategies for securely transmitting and storing the internal data used in RAG. Additionally, explore methods for identifying sensitive data and learn about best practices for subsequent measures to address these concerns.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.
reInforce2024 #CloudSecurity #AWS #AmazonWebServices #CloudComputing
Join this session to learn about Capital One’s strategic AWS Secrets Manager implementation that has helped ensure unified security across environments. Discover the key principles that can guide consistent use, with real-world examples to showcase the benefits and challenges faced. Gain insights into achieving reliability and resilience in financial services applications on AWS, including methods for maintaining system functionality amidst failures and scaling operations safely. Find out how you can implement chaos engineering and site reliability engineering using multi-Region services such as Amazon Route 53, AWS Auto Scaling, and Amazon DynamoDB.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.
reInforce2024 #CloudSecurity #AWS #AmazonWebServices #CloudComputing
Many companies are excited to build products using generative AI, but these large language models require protections against jailbreaking to help ensure safe, ethical use. This lightning talk covers best practices for protecting your generative AI application against threats that could make models behave undesirably. Explore approaches to mitigate risks from the start, helping you build responsibly.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.
reInforce2024 #CloudSecurity #AWS #AmazonWebServices #CloudComputing
Generative AI–based applications have the most business impact when they have access to critical business data and are empowered to take actions on behalf of the user. However, these integrations raise important security questions outlined in the OWASP Top 10 for LLM vulnerabilities and NIST Adversarial Machine Learning frameworks. This lightning talk introduces high-level architectural patterns to effectively mitigate key OWASP Top 10 for LLM vulnerabilities through Zero Trust principles. Leave this talk with best practices for building generative AI applications accessing sensitive business data using Agents for Amazon Bedrock.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.
reInforce2024 #CloudSecurity #AWS #AmazonWebServices #CloudComputing
The security and privacy of data during the training, fine-tuning, and inferencing phases of generative AI are paramount. This lightning talk introduces a reference architecture designed to use the security of AWS PrivateLink with generative AI applications. Explore the importance of protecting proprietary data in applications that leverage both AWS native LLMs and ISV-supplied external data stores. Learn about the secure movement and usage of data, particularly for RAG processes, across various data sources like Amazon S3, vector databases, and Snowflake. Learn how this reference architecture not only meets today’s security demands but also sets the stage for the future of secure generative AI development.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.
reInforce2024 #CloudSecurity #AWS #AmazonWebServices #CloudComputing
Amazon Q Business is a fully managed, generative AI–powered assistant that you can configure to answer questions, provide summaries, generate content, and complete tasks based on data in your enterprise. This lightning talk demonstrates how to authenticate and authorize users to your custom Amazon Q Business applications using the AWS IAM Identity Center trusted identity propagation feature.
Learn more about AWS re:Inforce at https://go.aws/reinforce.
Subscribe: More AWS videos: http://bit.ly/2O3zS75 More AWS events videos: http://bit.ly/316g9t4
ABOUT AWS Amazon Web Services (AWS) hosts events, both online and in-person, bringing the cloud computing community together to connect, collaborate, and learn from AWS experts.
AWS is the world's most comprehensive and broadly adopted cloud platform, offering over 200 fully featured services from data centers globally. Millions of customers—including the fastest-growing startups, largest enterprises, and leading government agencies—are using AWS to lower costs, become more agile, and innovate faster.