talk-data.com talk-data.com

Filter by Source

Select conferences and events

People (27 results)

See all 27 →

Activities & events

Title & Speakers Event

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Learn how modern DataOps is enabling advanced use cases beyond analytics in a half-day of virtual sessions where data leaders share how they leverage orchestration to power AI, ML, and production-grade data products.

  • 🔥Perks: Attendees will receive a free Airflow 3 DAG Authoring Certification ($150 value)!
  • Please Note: you must register on the event page here to save your spot.

WHAT TO EXPECT AT BEYOND ANALYTICS

  • Learn from Data Leaders: Data innovators share how they push the limits of what’s possible with data orchestration.
  • Explore What’s New: Discover the latest Airflow and Astro features built to support modern analytics, AI, and ML at scale.
  • Get Your Data AI Ready: Get practical guidance to help you implement and scale AI initiatives in production.

BECOME A CERTIFIED AIRFLOW 3 EXPERT Join Airflow expert Marc Lamberti, creator of Data with Marc, for a fast-track, expert-led introduction to Apache Airflow 3 fundamentals — designed to help you confidently prepare for the official Airflow 3 certification exam. Get your questions answered live, plus you’ll get a discount code for a free certification ($150 value).

FEATURED SPEAKERS

  • Ryan Delgado: Director of Engineering at Ramp
  • Julian LaNeve: CTO at Astronomer
  • Jacob Dodd: Senior Machine Learning Engineer at Laurel
  • Pete DeJoy: Co-Founder & CPO at Astronomer

BRINGING TOGETHER THE DATA ECOSYSTEM Beyond Analytics is presented by Astronomer and supported by the following partners.

Please Note: you must register on the event page here to save your spot.

Beyond Analytics: The DataOps Conference

Join fellow airflow enthusiasts and leaders at Ramp's Offices for an evening of engaging presentations, delicious food and drinks, and awesome swag!

PRESENTATIONS

How Ramp Fuels Growth with LLMs and Airflow

  • Speaker: Arman Vaziri, Staff Software Engineer, Ramp
  • At Ramp, LLMs and Airflow power a full-stack data engine that turns B2B data into go-to-market fuel. In this talk, Arman Vaziri shares how Ramp leverages LLMs to transform messy datasets into normalized, actionable insights — and activates it across automated outbound, a customer data platform, and various GTM applications.
  • You'll get an inside look at:
  • The role of Airflow in orchestrating LLM-powered outbound sales
  • How Ramp uses LLMs to turn unstructured data into value across the sales funnel
  • Lessons learned from building large-scale data pipelines on imperfect data

Whether you're scaling a startup or optimizing enterprise outbound, this talk will give you actionable insights into blending data engineering and AI for meaningful business impact.

Workflows then agents: the practical approach to enterprise AI

  • Speaker: Julian LaNeve, Chief Technology Officer, Astronomer
  • We've seen countless teams chase the mirage of autonomous agent swarms, only to get lost in complexity without delivering value. The truth? Most organizations don't need agents talking to agents – they need reliable LLM workflows that solve real business problems today. That's why we've open-sourced our AI SDK for Apache Airflow, distilling battle-tested patterns that have helped companies achieve transformative results without the science fiction complexity. In this talk, we'll walk through the SDK and a couple examples demonstrating how easy it is to work with.

AGENDA

  • 6-6:30PM: Arrivals, eat, drink, and network
  • 6:30-7:30PM: Presentations
  • 7:30-8PM: Networking
Beyond the Hype: Practical AI Workflows with Airflow
ClickHouse Meetup @ Ramp 2024-12-09 · 23:00

Join Zoom Meeting: https://ramp.zoom.us/j/87015612526?pwd=GbSZDny1yvX4k48A3U7qsrdYa9edPY.1

Hello ClickHouse Enthusiasts! We are thrilled to invite you another ClickHouse Meetup hosted at the Ramp Office in New York City! You'll have an opportunity to connect with fellow data professionals, share industry insights, and learn more about ClickHouse and how folks are using us to solve their data challenges.

Details of the Meetup: - Date: Monday\, December 9\, 2024 - Time: 6:00 PM to 9:00 PM - Location: Ramp Office\, 28 W 23rd St\, New York\, NY 10010

This evening will be filled with user presentations, interactive discussions, and a chance to network with experts and peers.

Agenda:

  • 5:30 PM: Arrivals, Check-In and Networking (food and drinks served)
  • 6:10 PM: Welcome and Introductions
  • 6:15 - 6:35 PM: Aaron Lisman (Director of Frontend Development, Memorial Sloan Kettering Cancer Center)
  • 6:40 - 7:00 PM: Julian LaNeve (CTO, Astronomer)
  • 7:05 - 7:25 PM: Leon Kozlowski (Data Engineering Manager, Flock Safety)
  • 7:35 - 8:15 PM: Q&A, Networking & Refreshments
  • 9:00 PM: Meetup Concludes

Space is limited, so please RSVP as soon as possible to secure your spot.

ClickHouse Meetup @ Ramp

Data engineers and pipeline managers know that producing data lineage – end-to-end pipeline metadata instrumented at runtime or parsed at design time – is a heavy lift without a shared standard for lineage metadata. It requires duplication of effort across pipeline tooling, and deployment of new tools can break existing lineage workflows. Getting useful lineage can seem like a Sisyphean task.

Enter OpenLineage, an increasingly adopted open standard for lineage metadata collection. It defines a generic model of run, job, and dataset entities identified using consistent naming strategies. The core lineage model is extensible by defining specific facets to enrich those entities. Join us at the Datadog Headquarters in NYC on November 19th at 6:00 pm to learn more about the OpenLineage spec and integrations. You’ll meet other members of the ecosystem, learn about the project’s goals and fundamental design, and participate in a robust discussion about the future of the project.

Agenda:

  • OpenLineage overview & project update

Julien Le Dem (Project lead) & Harel Shein (TSC member), OpenLineage

  • Interpreting OpenLineage events to power Astro Observe

Julian LaNeve (CTO) & Christine Shen (Software Engineer), Astronomer

  • How OpenLineage fits into the Datadog ecosystem

Igor Kravchenko (Staff Engineer) & Ryan Warrier (Sr. Product Manager), Datadog

Interpreting OpenLineage events to power Astro Observe Astronomer recently announced Observe, an observability platform powered by OpenLineage. We've created experiences designed around the reliability and efficiency of datasets delivered by Apache Airflow. To do so, we leverage the Airflow OpenLineage integration to get telemetry and lineage out of Airflow regardless of where it's running. We've created a processor framework that runs custom business logic depending on the event type and metadata included. In this talk, we'll dig under the covers and show our processor framework that allows us to easily extend the Observe platform into new use cases.

How OpenLineage fits into the Datadog ecosystem This talk explores how Datadog integrates with OpenLineage to provide observability solutions for data pipelines. The first part is a technical walkthrough of the architecture of how Datadog ingests, processes, and stores OpenLineage events. The second part covers a brief overview of Datadog’s data observability capabilities, how Datadog sees OpenLineage providing value to users, and a demo of Airflow and dbt monitoring built using OpenLineage events.

Thank you to our sponsors: Datadog LFAI & Data Foundation

Enter from 620 8th Ave, check in at the left desk and take the elevators up to the 45th floor.

NYC OpenLineage meetup at Datadog
David Xue – Machine Learning Engineer @ Astronomer , Julian LaNeve – Chief Technology Officer at Astronomer @ Astronomer

Julian and David will cover the Hackathon project they worked on that won at the New York Stock Exchange— fine tuning an LLM to generate summaries for airflow task failures.

llms fine-tuning NLP Airflow
Jarek Potiuk – Independent Open-Source Contributor and Advisor @ Apache Software Foundation

Apache Airflow relies on a silent symphony behind the scenes: its CI/CD (Continuous Integration/Continuous Delivery) and development tooling. This presentation explores the critical role these tools play in keeping Airflow efficient and innovative. We'll delve into how robust CI/CD ensures bug fixes and improvements are seamlessly integrated, while well-maintained development tools empower developers to contribute effectively.

Airflow ci/cd dev tools