Data is at the center of many challenges in system design today. Difficult issues such as scalability, consistency, reliability, efficiency, and maintainability need to be resolved. In addition, there's an overwhelming variety of tools and analytical systems, including relational databases, NoSQL datastores, plus data warehouses and data lakes. What are the right choices for your application? How do you make sense of all these buzzwords? In this second edition, authors Martin Kleppmann and Chris Riccomini build on the foundation laid in the acclaimed first edition, integrating new technologies and emerging trends. You'll be guided through the maze of decisions and trade-offs involved in building a modern data system, from choosing the right tools like Spark and Flink to understanding the intricacies of data laws like the GDPR. Peer under the hood of the systems you already use, and learn to use them more effectively Make informed decisions by identifying the strengths and weaknesses of different tools Navigate the trade-offs around consistency, scalability, fault tolerance, and complexity Understand the distributed systems research upon which modern databases are built Peek behind the scenes of major online services, and learn from their architectures

Data storytelling isn't just about presenting numbers—it's about creating shared wisdom that drives better decision-making. In our increasingly polarized world, we often miss that most people actually have reasonable views hidden behind the loudest voices. But how can technology help us cut through the noise and build genuine understanding? What if AI could help us share stories across different communities and contexts, making our collective knowledge more accessible? From reducing unnecessary meetings to enabling more effective collaboration, the way we exchange information is evolving rapidly. Are you prepared for a future where AI helps us communicate more effectively rather than replacing human judgment? Professor Alex “Sandy” Pentland is a leading computational scientist, co-founder of the MIT Media Lab and Media Lab Asia, and a HAI Fellow at Stanford. Recognized by Forbes as one of the world’s most powerful data scientists, he played a key role in shaping the GDPR through the World Economic Forum and contributed to the UN’s Sustainable Development Goals as one of the Secretary General’s “Data Revolutionaries.” His accolades include MIT’s Toshiba Chair, election to the U.S. National Academy of Engineering, the Harvard Business Review McKinsey Award, and the DARPA 40th Anniversary of the Internet Award. Pentland has served on advisory boards for organizations such as the UN Secretary General, UN Foundation, Consumers Union, and formerly for the OECD, Google, AT&T, and Nissan. Companies originating from his lab have driven major innovations, including India’s Aadhaar digital identity system, Alibaba’s news and advertising arm, and the world’s largest rural health service network. His more recent ventures span mental health (Ginger.io), AI interaction management (Cogito), delivery optimization (Wise Systems), financial privacy (Akoya), and fairness in social services (Prosperia). A mentor to over 80 PhD students—many now leading in academia, research, or entrepreneurship—Pentland helped pioneer fields such as computational social science, wearable computing, and modern biometrics. His books include Social Physics, Honest Signals, Building the New Economy, and Trusted Data. In the episode, Richie and Sandy explore the role of storytelling in data and AI, how technology reshapes our narratives, the impact of AI on decision-making, the importance of shared wisdom in communities, and much more. Links Mentioned in the Show: MIT Media LabSandy’s Booksdeliberation.ioConnect with SandySkill Track: Artificial Intelligence (AI) LeadershipRelated Episode: The Human Element of AI-Driven Transformation with Steve Lucas, CEO at BoomiRewatch RADAR AI  New to DataCamp? Learn on the go using the DataCamp mobile appEmpower your business with world-class data and AI skills with DataCamp for business

Overview of modernizing finance processes, AI augmentation vs automation, compliance and GDPR, and building trust when introducing AI in a regulated finance function.

RSG Group – the global fitness powerhouse behind Gold’s Gym, McFIT, and JOHN REED – modernized its fragmented, manual data infrastructure into a scalable, low-maintenance analytics platform using Snowflake, Fivetran, and Coalesce. With a lean team and growing data needs across 900+ studios in 30 countries, the company replaced brittle pipelines and slow onboarding with automated ingestion, governed transformations, and self-service analytics. In this session, Head of Data & Business Intelligence Christopher Rüge will share how RSG Group reduced data integration time from 80 hours to 30 minutes, established end-to-end lineage and GDPR compliance with Coalesce, enabled data-driven decisions, and a strong foundation for AI use cases like personalization, churn prediction, and operational insights.

Toestemming lijkt dé manier om persoonsgegevens te verwerken, maar is vaak niet voldoende of toegestaan. Veel organisaties gebruiken het standaard, terwijl het juridisch niet altijd houdbaar is. Bram Hoovers en Julia Buhrs laten zien waarom toestemming geen vrijbrief is en hoe je AVG-proof werkt met andere grondslagen. Met praktijkvoorbeelden en inzichten krijg je grip op dataverwerking binnen jouw organisatie.

Presents a structured approach to privacy management, an indispensable resource for safeguarding data in an ever-evolving digital landscape In today’s data-driven world, protecting personal information has become a critical priority for organizations of all sizes. Building Effective Privacy Programs: Cybersecurity from Principles to Practice equips professionals with the tools and knowledge to design, implement, and sustain robust privacy programs. Seamlessly integrating foundational principles, advanced privacy concepts, and actionable strategies, this practical guide serves as a detailed roadmap for navigating the complex landscape of data privacy. Bridging the gap between theoretical concepts and practical implementation, Building Effective Privacy Programs combines in-depth analysis with practical insights, offering step-by-step instructions on building privacy-by-design frameworks, conducting privacy impact assessments, and managing compliance with global regulations. In-depth chapters feature real-world case studies and examples that illustrate the application of privacy practices in a variety of scenarios, complemented by discussions of emerging trends such as artificial intelligence, blockchain, IoT, and more. Providing timely and comprehensive coverage of privacy principles, regulatory compliance, and actionable strategies, Building Effective Privacy Programs: Addresses all essential areas of cyberprivacy, from foundational principles to advanced topics Presents detailed analysis of major laws, such as GDPR, CCPA, and HIPAA, and their practical implications Offers strategies to integrate privacy principles into business processes and IT systems Covers industry-specific applications for healthcare, finance, and technology sectors Highlights successful privacy program implementations and lessons learned from enforcement actions Includes glossaries, comparison charts, sample policies, and additional resources for quick reference Written by seasoned professionals with deep expertise in privacy law, cybersecurity, and data protection, Building Effective Privacy Programs: Cybersecurity from Principles to Practice is a vital reference for privacy officers, legal advisors, IT professionals, and business executives responsible for data governance and regulatory compliance. It is also an excellent textbook for advanced courses in cybersecurity, information systems, business law, and business management.

Customer Data Platforms (CDPs) promise better engagement, higher operational efficiency, and revenue growth by centralizing and streamlining access to customer data. However, consolidating sensitive information from a variety of sources creates complex challenges around data governance, security, and privacy. We’ve studied, built, and managed data protection strategies at some of the world’s biggest retailers. We’ll showcase business requirements, common architectural components, and best practices to deploy data protection solutions at scale, protecting billions of sensitive records across regions and countries. Learn how a data vault pattern with granular, policy-based access control and monitoring can improve organizational privacy posture and help meet regulatory requirements (e.g., GDPR, CCPA, e-Privacy). Walk away with a clear framework to deploy such architecture and knowledge of real-world issues, performance optimizations, and design trade-offs

The Trump 2 AI agenda prioritizes US AI leadership by opposing AI regulation on bias and frontier AI risks, favoring innovation and AI expansion. With comprehensive federal AI regulation unlikely, states are advancing AI laws addressing bias, harmful content, transparency, frontier model risk and other risks. Meanwhile, the EU AI Act effectively imposes global obligations. The emerging patchwork of state rules will burden US companies more than would a unified federal approach, seemingly undermining White House deregulatory goals. So, ironically, the Trump team AI agenda may accelerate disparate state-level regulation and impede AI innovation. US companies therefore face a fragmented landscape similar to privacy regulation where the EU AI Act — in the role of GDPR — has set the stage, and the states are asserting themselves with various incremental requirements. Other recent developments covered will include the finalization of the EU GPAI Code of Practice, certain newly enacted state laws, and a quick overview of AI regulation outside the U.S. and EU.

With regulations like LGPD (Brazil's General Data Protection Law) and GDPR, managing sensitive data access is critical. This session demonstrates how to leverage Databricks Unity Catalog system tables and data lineage to dynamically propagate classification tags, empowering organizations to monitor governance and ensure compliance. The presentation covers practical steps, including system table usage, data normalization, ingestion with Lakeflow Declarative Pipelines and classification tag propagation to downstream tables. It also explores permission monitoring with alerts to proactively address governance risks. Designed for advanced audiences, this session offers actionable strategies to strengthen data governance, prevent breaches and avoid regulatory fines while building scalable frameworks for sensitive data management.

Marketing teams struggle with ‘dirty data’ — incomplete, inconsistent, and inaccurate information that limits campaign effectiveness and reduces the accuracy of AI agents. Our AI-powered marketing data management platform, built on Databricks, solves this with anomaly detection, ML-driven transformations and the built-in Acxiom Referential Real ID Graph with Data Hygiene.We’ll showcase how Delta Lake, Unity Catalog and Lakeflow Declarative Pipelines power our multi-tenant architecture, enabling secure governance and 75% faster data processing. Our privacy-first design ensures compliance with GDPR, CCPA and HIPAA through role-based access, encryption key management and fine-grained data controls.Join us for a live demo and Q&A, where we’ll share real-world results and lessons learned in building a scalable, AI-driven marketing data solution with Databricks.

Organizations have limited time to meet requirements with the coming of European AI Act. This may likely have more impact than the GDPR did. It is critical to take action now. The US, China and others have their own strategies. Join us to know how D&A leaders can plan and execute strategy in this fragmented landscape, and how ethics, governance and practical strategy help achieve durable AI value.

AI is transforming industries, but it’s also raising complex questions about data protection and privacy. EDPB Opinion 28/204 provides guidance specifically for GDPR practitioners dealing with AI.

00:00 Introduction to AI and GDPR 00:33 Understanding Anonymity in AI Models 01:53 Framework for Determining Anonymity 03:30 Practical Steps for GDPR Compliance 06:16 Exploring Legitimate Interests 07:19 The Three-Step Test for Legitimate Interests 10:18 Navigating Legitimate Interests 10:34 Understanding the Balancing Test 11:17 Risks and Rights in AI Data Processing 14:59 Mitigating Measures for Data Protection 17:16 Web Scraping and Data Protection 18:24 Consequences of Unlawful Data Processing 20:13 Key Takeaways for GDPR Practitioners

🌟 Session Overview 🌟

Session Name: Using Your Digital Twin to Understand the Effect of Future Changes Speaker: Henrik Ekstam Session Description: In his upcoming speech, Henrik will explore the transformative potential of creating and maintaining a digital twin of an organization. He will explain how a digital twin—a virtual replica of the organization's processes, IT infrastructure, and overall operational framework—serves as a powerful tool for modeling and simulating the impacts of both internal and external changes. By leveraging this digital counterpart, organizations can effectively anticipate and manage the repercussions of new strategies, mergers, and acquisitions, as well as external factors such as global events like the COVID-19 pandemic and regulatory changes such as GDPR. Through insightful examples and practical applications, Henrik will demonstrate how this innovative approach enables organizations to navigate complexity, enhance decision-making, and drive sustainable transformation in an ever-evolving business landscape.

🚀 About Big Data and RPA 2024 🚀

Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! 🌟 This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. 🚀 Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Don’t miss this exclusive opportunity to expand your expertise and revolutionize your processes—all from the comfort of your home! 📊🤖✨

📅 Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! 🚀 🔗 Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP

💡 Stay Connected & Updated 💡

Don’t miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!

🌐 Website: https://bigdataconference.eu/, https://rpaconference.eu/ 👤 Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ 🐦 Twitter: @BigDataConfEU, @europe_rpa 🔗 LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ 🎥 YouTube: http://www.youtube.com/@DATAMINERLT

🌟 Session Overview 🌟

Session Name: GDPR Design for Websites, Apps and (Ro)Bots Speaker: Kateryna Dubas Session Description: Everyone has heard of the principles of data protection by design and by default. But how do we comply with these requirements? What are the existing best practices and enforcement histories? Do we need to examine the code or database to verify GDPR compliance? This talk will help navigate the law and supporting guidelines to create privacy-preserving and compliant architectures.

🚀 About Big Data and RPA 2024 🚀

Unlock the future of innovation and automation at Big Data & RPA Conference Europe 2024! 🌟 This unique event brings together the brightest minds in big data, machine learning, AI, and robotic process automation to explore cutting-edge solutions and trends shaping the tech landscape. Perfect for data engineers, analysts, RPA developers, and business leaders, the conference offers dual insights into the power of data-driven strategies and intelligent automation. 🚀 Gain practical knowledge on topics like hyperautomation, AI integration, advanced analytics, and workflow optimization while networking with global experts. Don’t miss this exclusive opportunity to expand your expertise and revolutionize your processes—all from the comfort of your home! 📊🤖✨

📅 Yearly Conferences: Curious about the evolution of QA? Check out our archive of past Big Data & RPA sessions. Watch the strategies and technologies evolve in our videos! 🚀 🔗 Find Other Years' Videos: 2023 Big Data Conference Europe https://www.youtube.com/playlist?list=PLqYhGsQ9iSEpb_oyAsg67PhpbrkCC59_g 2022 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEryAOjmvdiaXTfjCg5j3HhT 2021 Big Data Conference Europe Online https://www.youtube.com/playlist?list=PLqYhGsQ9iSEqHwbQoWEXEJALFLKVDRXiP

💡 Stay Connected & Updated 💡

Don’t miss out on any updates or upcoming event information from Big Data & RPA Conference Europe. Follow us on our social media channels and visit our website to stay in the loop!

🌐 Website: https://bigdataconference.eu/, https://rpaconference.eu/ 👤 Facebook: https://www.facebook.com/bigdataconf, https://www.facebook.com/rpaeurope/ 🐦 Twitter: @BigDataConfEU, @europe_rpa 🔗 LinkedIn: https://www.linkedin.com/company/73234449/admin/dashboard/, https://www.linkedin.com/company/75464753/admin/dashboard/ 🎥 YouTube: http://www.youtube.com/@DATAMINERLT

This episode explores the complexities of international data transfers under GDPR, detailing the criteria established by the European Data Protection Board. It outlines the three criteria to determine when data crossing EU borders qualifies as a transfer under Chapter V of GDPR, along with discussions on adequacy decisions, the EU-US Data Privacy Framework, and practical applications of standard contractual clauses (SCCs). Binding corporate rules (BCRs) and limited exceptions, or derogations, are also explained as methods for legitimate data transfers without adequacy.

00:00 Introduction to International Data Transfers

00:34 Understanding GDPR's Transfer Criteria

01:36 Real-World Examples of Data Transfers

02:08 When Transfers Don't Count

03:23 Green Lights for Data Transfers: Adequacy Decisions

04:00 The EU-US Data Privacy Framework

05:34 Safeguards for Data Transfers

05:49 Standard Contractual Clauses (SCCs) and Binding Corporate Rules (BCRs)

07:20 Exceptions and Derogations

11:47 The Importance of Documentation

13:00 Risk Awareness and Conclusion

Our next episode explores the complexities of international data transfers under GDPR, detailing the criteria established by the European Data Protection Board. It outlines the three criteria to determine when data crossing EU borders qualifies as a transfer under Chapter V of GDPR, along with discussions on adequacy decisions, the EU-US Data Privacy Framework, and practical applications of standard contractual clauses (SCCs). Binding corporate rules (BCRs) and limited exceptions, or derogations, are also explained as methods for legitimate data transfers without adequacy.

Storebrand is a financial institution in Norway with several independent verticals — banking, pensions, insurance, asset management, properties — and horizontals across corporate and personal markets. To meet the matrix of data needs, Storebrand has needed to develop several data warehouses. They're now two years into the journey of building a new data platform, based on Snowflake and dbt, with four people in the platform team — and they're now scaling that central platform to the whole enterprise, with dbt Mesh. This requires automation of infrastructure and permissions to be regulatory compliant, data governance, clear separation of duties between the platform team and the data teams — for example, who has the responsibility for data masking and GDPR deletions? — a great developer experience, and a lot of good will. This presentation will try to answer how they've done it so far, and their plans to scale it from here.

Speaker: Eivind Berg Tech Lead Data Platform Storebrand

Read the blog to learn about the latest dbt Cloud features announced at Coalesce, designed to help organizations embrace analytics best practices at scale https://www.getdbt.com/blog/coalesce-2024-product-announcements

Think GDPR is just corporate jargon? Think again! This episode breaks down exactly what GDPR means for YOU, from its core principles to how it actually protects your data. We'll unpack your rights, how to hold companies accountable, and real-world examples of GDPR in action. Get ready to take charge of your digital life!

Links:

GDPR Aware Handbook by Siarhei Varankevich CIPP/E, CIPM, CIPT, FIP: https://data-privacy-office.eu/usefull-materials/gdpr-aware-handbook/

Tired of Surface-Level Data Privacy Training?

This episode explores DPO Europe's Global Data Privacy Manager course and why it's different. We break down how this course goes beyond the basics to help you take action, build a program, and become a confident leader in data privacy. If you're ready to move past the "now what?" and tackle real-world challenges, tune in!

Starting your privacy journey? This episode unpacks the essentials of GDPR: why it matters, how it works, and what it means for your career. We'll explore real-world scenarios, practical skills, and why this training is key for any aspiring privacy pro.

Links:

GDPR DPP Training - https://data-privacy-office.eu/courses/gdpr-data-privacy-professional/