talk-data.com

Let’s kick things off for another meetup, this time focusing on building a scalable, decentralized data platform and business intelligence. Join us for an engaging Meetup on May 22nd in Berlin - bring all your questions!

Lessons from the Cloud: Building a Scalable, Decentralized Data Platform with Snowflake, dbt & S3

Fahad Hassan, data engineering team lead at Ratepay, will share practical patterns and lessons learned while designing a multi-warehouse data platform across analytics, risk, and finance — including decisions to simplify modeling, decentralize ownership, and optimize cost and governance in Snowflake. He’ll also highlight challenges faced with legacy systems and how Ratepay tackled them using dbt and clean lake structures.

Business Intelligence in practice: Dagster & DBT

Enabling the business to make informed decisions based on data requires a lot of developer work. From integrating external partner services to building data models, you need to make sure the data is fresh and can be relied upon to see the full scope of the problem. Emilija Dankevičiūtė, a data engineer from diconium data, will present an architecture that uses Dagster and dbt to build a central data processing platform.

What to expect:

• Two expert talks
• Interactive Q&A
• Networking opportunities
• Some snacks & drinks :)

Timetable:

• 18:30 - Event admission
• 18:50 - Welcome & Introduction
• 19:00 - Business Intelligence in practice: Dagster & DBT - Emilija Dankevičiūtė
• 19:30 - 5 minutes break
• 19:35 - Lessons from the Cloud: Building a Scalable, Decentralized Data Platform with Snowflake, dbt & S3 - Fahad H.
• 20:05 - Snacks, Drinks & Networking
• 21:30 - End

More on the -> applydata data engineering meetup page.

Our goal is to form a local data-loving community, so join us and let's talk data together!

--- At the event, sound, image and video recordings are created and published for documentation purposes as well as for the presentation of the event in publicly accessible media, on websites and blogs and for presentation on social media. By participating the event, the participant implicitly consents to the aforementioned photo and/or video recordings. Find more information on data protection here.

Let’s kick things off for another meetup, this time focussing on scaling analytics with dbt and simplifying Kubernetes job execution. Join us for an engaging meetup on March 13th in Berlin!

Scaling Analytics with dbt: From Implementation to Impact

Managing data transformations, ensuring data quality, and fostering collaboration across teams present significant challenges in data management. This talk will explore the implementation of dbt in a project, highlighting its impact on workflow efficiency, key benefits, and encountered challenges.

Kube API: Simplifying Kubernetes Job Execution

Let’s focus on how Kube API simplifies and streamlines interactions with Kubernetes, particularly in managing jobs and workloads through a unified interface. We will share the concept of Kube API as a custom wrapper built on top of Kubernetes, acting as a microservice that provides a seamless experience for clients. The idea is to share how the REST API makes it easy for any one to create, manage, and monitor Kubernetes jobs without having to deal with Kubernetes’ inherent complexities.

What to expect:

• Expert talks
• Interactive Q&A
• Networking opportunities
• Some snacks & drinks :)

Timetable:

• 18:30 - Event admission
• 18:50 - Welcome & Introduction
• 19:00 - Scaling Analytics with dbt (Ceren Gündoğdu)
• 19:30 - 5 minutes break
• 19:35 - Simplifying Kubernetes Job Execution (Ajit Gosavi)
• 20:05 - Snacks, Drinks & Networking
• 21:30 - End

More on the -> applydata data engineering meetup page.

Our goal is to form a local data-loving community, so join us and let's talk Data together!

---

At the event, sound, image and video recordings are created and published for documentation purposes as well as for the presentation of the event in publicly accessible media, on websites and blogs and for presentation on social media. By participating the event, the participant implicitly consents to the aforementioned photo and/or video recordings. Find more information on data protection here.

What are dbt meetups? dbt Meetups are networking events open to all folks working with data! Talks predominantly focus on community members' experience with dbt, however, you'll catch presentations on broader topics such as analytics engineering, data stacks, data ops, modeling, testing, and team structures.

➡️ Join the dbt Slack community: https://www.getdbt.com/community/ and make sure to add the #local-berlin channel in dbt Slack to be part of the conversation. 🤝 Organizers: Andre Wagner (Taxfix), Victoria Perez Mola (dbt Labs) 🏢 Venue: Taxfix Office - Koepenicker Str 122

To attend, please read the Health and Safety Policy and Terms of Participation: https://www.getdbt.com/legal/health-and-safety-policy

📝Agenda

• 6:00 PM: Check in/Registration
• 6:30 PM: Welcome Remarks 🎤 (Andre Wagner, Taxfix)
• 6:35 PM: What’s new with dbt? 🎤 (Stephan Durry, dbt Labs)
• 6:50 PM: 1. Talk: How Analytics Engineering Works at Taxfix: Our Setup & Best dbt Tricks 🎤 (Taxfix Team, Taxfix)
• 7:30 PM: 2. Talk: A strategic approach to testing with Data Products in dbt 🎤 (Mikkel Dengsøe, Synq)
• 8:10: Networking & Reception

Note: Closing doors at 6:40 ---------------------------------- dbt is the standard in data transformation, used by over 40,000 organizations worldwide. Through the application of software engineering best practices like modularity, version control, testing, and documentation, dbt’s analytics engineering workflow helps teams work more efficiently to produce data the entire organization can trust. Learn more: https://www.getdbt.com/

What are dbt meetups? dbt Meetups are networking events open to all folks working with data! Talks predominantly focus on community members' experience with dbt, however, you'll catch presentations on broader topics such as analytics engineering, data stacks, data ops, modeling, testing, and team structures.

➡️ Join the dbt Slack community: https://www.getdbt.com/community/ and make sure to add the #local-berlin channel in dbt Slack to be part of the conversation. 🤝 Organizers: Eva Schreyer (NEUGELB Studios), Victoria Perez Mola (dbt Labs) 🏢 Venue: NEUGELB Studios in Kreuzberg

To attend, please read the Health and Safety Policy and Terms of Participation: https://www.getdbt.com/legal/health-and-safety-policy

📝Agenda

• 6:00 PM \| Check in/Registration
• 6:30 PM \| Welcome Remarks & Housekeeping by NEUGELB
• 6:45 PM \| What's new with dbt? What have you missed at coalesce? 🎤(Lucas Silbernagel, dbt Labs)
• 7:00 PM \| 1. Talk: Making the most out of dbt tests 🎤 (Tim Hiebenthal)
• 7:30 PM \| 2. Talk: If your code get an attitude\, test it like it's hot! From data to unit testing in one build. 🎤(Victoria Perez Mola, dbt Labs)
• 8:00 PM \| 3. Talk: "Should we build this in Looker or dbt?" 🎤(Sarah Levy, Euno)
• 8:30 \| Networking & Reception

---------------------------------- dbt is the standard in data transformation, used by over 40,000 organizations worldwide. Through the application of software engineering best practices like modularity, version control, testing, and documentation, dbt’s analytics engineering workflow helps teams work more efficiently to produce data the entire organization can trust. Learn more: https://www.getdbt.com/

Welcome to the PyData Berlin November meetup!

We would like to welcome you all starting from 18:45. There will be food and drinks. The talks begin around 19.30 and the doors will close at 19:30. Make sure to arrive on time!

Please provide your first and last name for the registration because this is required for the venue's entry policy. If you cannot attend, please cancel your spot so others are able to join as the space is limited.

Host: Bonial is excited to welcome you to this month's version of PyData. ************************************************************************** The Lineup for the evening

Talk 1: Running Python data transformations at scale with dbt and Astronomer Cosmos Abstract: I will discuss how we built a tool using dbt and Astronomer Cosmos to orchestrate Python data transformations at scale. As part of a global team, we faced the challenge of developing and scaling data transformations for our entities across more than 50 countries. Our data scientists write these transformations to improve our machine learning models, and the need to manage such a large number of entities required an efficient and scalable solution. This tool streamlines the entire process, enabling data scientists to quickly develop data transformations, leverage built-in dbt tests for data validation, and seamlessly deploy these transformations to production environments. The integration of dbt and Astronomer Cosmos has significantly accelerated our workflows, ensuring robust and scalable data operations while also empowering our data scientists to deliver more value, faster.

Speaker: Galuh Sahid currently works as a Senior Machine Learning Engineer at Delivery Hero. She is also recognized as a Google Developer Expert in Machine Learning. She previously worked at Twitter and Gojek. She has developed and productionized various ML applications, including fraud detection, content moderation, and marketing using traditional ML, NLP, and computer vision. In her free time, Galuh enjoys painting and hiking.

Talk 2: Anomaly Detection in Track Scenes Abstract: In the “Digitale Schiene Deutschland” initiative, Deutsche Bahn is developing an automated train driving system. To support this, we collaborated with them to create a machine learning solution that detects anomalous objects on and around tracks using onboard RGB cameras. Rather than recognizing specific object classes (e.g., people, signals), this system identifies any object and ranks it by anomaly. This presentation covers challenges, approaches, and the final solution: a unique pipeline using multiple machine learning components, including monocular depth estimation, segmentation, image embedding, and anomaly detection. The OSDAR23 dataset, containing 45 scenes with RGB, infrared, radar, and lidar data, aids in model finetuning and evaluation. Additionally, unannotated data was used for self-supervised learning.

Speaker: Maximilian Trescher studied physics in Berlin and Paris, PhD in theoretical physics in 2018 (Freie Universität Berlin). Then he worked 4 years (18-22) as a software engineer (Java, databases etc). Since 2022 he is a machine learning Scientist at dida (www.dida.do).

Lightning talks There will be slots for 2-3 Lightning Talks (3-5 Minutes for each). Kindly let us know if you would like to present something at the start of the meetup :)

*** NumFOCUS Code of Conduct THE SHORT VERSION Be kind to others. Do not insult or put down others. Behave professionally. Remember that harassment and sexist, racist, or exclusionary jokes are not appropriate for NumFOCUS. All communication should be appropriate for a professional audience including people of many different backgrounds. Sexual language and imagery are not appropriate. NumFOCUS is dedicated to providing a harassment-free community for everyone, regardless of gender, sexual orientation, gender identity, and expression, disability, physical appearance, body size, race, or religion. We do not tolerate harassment of community members in any form. Thank you for helping make this a welcoming, friendly community for all. If you haven't yet, please read the detailed version here: https://numfocus.org/code-of-conduct ***

This dbt Meetup is an opportunity for the local Berlin dbt Community to connect and collaborate. If you work with data, this event is for you. We welcome data analysts, scientists, engineers, architects, and more!

➡️ Join the dbt Slack community: https://www.getdbt.com/community/ and make sure to add the #local-berlin channel in dbt Slack to be part of the conversation. 🤝 Organizers: Eva Schreyer (NEUGELB Studios), Victoria Perez Mola (dbt Labs) 🏢 Venue: NEUGELB Studios in Kreuzberg

-----------

Agenda & Speakers

• 18:00 - Check-in\, Networking
• 18:30 - Welcome Remarks from Neugelb
• 18:45 - Talk: New developments from dbt by 🎤 Victoria Perez Mola (dbt Labs)
• 19:00 - Talk + Q&A: 'Harmonizing Structure with Flexibility: How we made a Monolithic dbt Project Structure Work in a Decentralized Organization' by 🎤 Lucas Silbernagel (Enpal). He will talk about how they implemented dbt and built a centralized (monolithic) structure despite being a decentralized company. [dbt Cloud]
• 19:45 - Talk + Q&A: 'pre-loved luxury fashion in dbt core' by 🎤 Jimmy Pang (Vestiaire Collective) [dbt Core]
• 20:30 (or earlier) - Networking

To attend, please read the Required Participation Language for In-Person Events with dbt Labs: https://www.getdbt.com/legal/health-and-safety-policy

------------ What is dbt? dbt allows teams to ship trusted data products, faster. dbt is a data transformation framework that lets analysts and engineers collaborate using their shared knowledge of SQL. Through the application of software engineering best practices like modularity, version control, testing, and documentation, dbt’s analytics engineering workflow helps teams work more efficiently to produce data the entire organization can trust.

Learn more: https://www.getdbt.com/