talk-data.com

The Student Zone is a beginner-friendly, virtual event where experts will teach you how to build amazing projects - all using C# and .NET! This year, our experts will walk you through building powerful web apps and AI-infused applications. Then, we'll bring in .NET hiring managers, interns, and more to give you up-to-date career advice. Tune in on November 18, ask questions live, and train with the experts!

AGENDA

| Speaker | Timing | Title | Abstract | | -------------------------------------- | ------------- | ------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Japhlet Nwamu, Krishna Regulavalasa | 60 minutes | From Code to Cloud: Building a Personal Portfolio with .NET & GitHub Codespaces | Join us for an engaging session where we dive into the world of GitHub Codespaces and .NET development. In this hands-on workshop, you'll learn how to create, customize, and deploy your own portfolio website using the GitHub Codespaces template for .NET. This session is perfect for developers of all levels looking to showcase their tech skills. By the end of this session, you'll have a fully functional portfolio site and a solid understanding of how to leverage GitHub Codespaces for your future projects. | | Bruno Capuano, Olanrewaju Oyinbooke | 60 minutes | Dive into the Future: .NET and AI! | Get ready for a cool session with the latest in .NET technology! This session is your ticket to understanding the amazing features and updates of the .NET platform. Experience the integration of advanced AI capabilities within the .NET ecosystem. Plus, get an exclusive look at .NET Aspire – the revolutionary stack that's transforming cloud-native development and making Azure deployments smoother than ever. | | Rubal Virdi | 15-20 minutes | Navigating Your Early Career in Tech: Tips from a Recruiter | Join us for an insightful interview with Rubal, an early-in-career recruiter, as we dive into essential tips and strategies for aspiring software developers. In this session, Rubal will share valuable advice on crafting standout resumes, acing interviews, and making a strong impression in the tech industry. Whether you're just starting your journey or looking to refine your approach, this session will provide you with the tools and knowledge to navigate your early career with confidence. Don't miss this opportunity to gain insider insights and ask your burning questions! | | Jeff Schwartz | 15-20 minutes | .NET Interview Insights: Tips from a Hiring Manager | Join us for an engaging interview with Jeff, an experienced .NET hiring manager, as he shares his expert advice for aspiring .NET software engineers. In this session, Jeff will discuss the key skills he looks for in candidates, the types of questions he typically asks during interviews, and his top tips for standing out in the competitive job market. Whether you're preparing for your first .NET role or looking to advance your career, this session will provide you with valuable insights and practical advice to help you succeed. Don't miss this chance to learn from a seasoned professional and get your questions answered! | | Mikelle Rogers | 15-20 minutes | Day in the Life of a .NET Engineer: Insights from Mikelle | Join us for an interview with Mikelle, an early-in-profession .NET developer, as she shares her journey from securing her current role as a software engineer to her initial experience learning .NET. In this session, Mikelle will discuss her path to becoming a .NET developer, including the challenges she faced and the strategies she used to overcome them. She will also provide insights into her day-to-day experiences on the job, offering a glimpse into the life of a software engineer. Whether you're just starting out or looking to learn more about the .NET field, this session will provide valuable perspectives and practical advice. Don't miss this opportunity to hear from someone who has successfully navigated the early stages of a .NET career! | | Heather Walicki | 15-20 minutes | Switching Gears: Heather's Path to .NET Development | Join us for an interview with Heather, a career-changer and Software Engineering Manager at Geocaching HQ. In this session, Heather will share her unique journey transitioning into software development and becoming a .NET developer. We'll also discuss her current role at Geocaching HQ and provide insights into her day-to-day work. Heather will also offer valuable tips and advice for others considering a career switch into the tech industry. Whether you're contemplating a career change or looking to learn more about the .NET field, this session will provide you with practical guidance and inspiration. Don't miss this opportunity to hear from someone who has successfully navigated a significant career transition! | | Victor Olet | 15-20 minutes | Accelerating HPC Workloads with Azure Batch and .NET | Join Victor as he explores the exciting intersection of High-Performance Computing (HPC) and cloud automation through Azure Batch with .NET. Drawing from both his PhD research and professional experience, Victor will demonstrate how to automate and scale complex workloads. Learn how he leverages Azure Batch to orchestrate parallel computing workflows efficiently with C#/.NET applications —ensuring cost-effective resource management, error handling, and seamless cloud operations. Whether you're new to HPC or looking to enhance your skills in automating large-scale tasks, this session offers practical insights into bridging academic research with real-world cloud computing solutions. | | Nicklas Olsen | 15-20 minutes | My Journey as a Microsoft Learn Student Ambassador | Join this session to hear Nicklas's story as a Microsoft Learn Student Ambassador and discover how it helped him get involved in the tech community and to build a network in the IT world. Learn about his experiences with writing blogs, giving talks, and how these activities played a key role in his growth. If you're a student interested in joining the Microsoft Learn Student Ambassador program but unsure how it can help you, this session is for you. |

Pre-requisites: * Get C# certified: https://aka.ms/csharp/certification * Learn .NET Aspire: https://aka.ms/dotnet/beginnervideos/aspire * See event resources: https://aka.ms/dotnetconf/students/resources

Use GitHub’s powerful project features to manage your software development process. We’ll cover project management with issues, pull requests, and tracking changes. At the end of the session, you may even receive a free GitHub certification voucher.*

*Offer good only while supplies last. Limit one GitHub voucher per person. This offer is non-transferable and cannot be combined with any other offer. This offer ends on June 27, 2024 or while supplies last, and is not redeemable for cash. Taxes, if any, are the sole responsibility of the recipient. Microsoft reserves the right to cancel, change, or suspend this offer at any time without notice.

Full series information

Follow on Microsoft Learn:

• Complete the Learn module

• Complete the Learn module (2)

• Complete the Learn module (3)

Learning objectives:

• Use GitHub Issues to manage a project

• Work with Pull Requests to review changes

Presenters:

Bruno Capuano (LinkedIn/Twitter)

Senior Cloud Advocate - Microsoft

Chris Noring (LinkedIn/Twitter)

Senior Cloud Advocate- Microsoft

Moderators:

Fernando Aguilar (LinkedIn)

Microsoft Student Ambassador

Use GitHub’s powerful project features to manage your software development process. We’ll cover project management with issues, pull requests, and tracking changes. At the end of the session, you may even receive a free GitHub certification voucher.*

*Offer good only while supplies last. Limit one GitHub voucher per person. This offer is non-transferable and cannot be combined with any other offer. This offer ends on June 27, 2024 or while supplies last, and is not redeemable for cash. Taxes, if any, are the sole responsibility of the recipient. Microsoft reserves the right to cancel, change, or suspend this offer at any time without notice.

Full series information

Follow on Microsoft Learn:

• Complete the Learn module

• Complete the Learn module (2)

• Complete the Learn module (3)

Learning objectives:

• Use GitHub Issues to manage a project

• Work with Pull Requests to review changes

Presenters:

Bruno Capuano (LinkedIn/Twitter)

Senior Cloud Advocate - Microsoft

Chris Noring (LinkedIn/Twitter)

Senior Cloud Advocate- Microsoft

Moderators:

Fernando Aguilar (LinkedIn)

Microsoft Student Ambassador

Find out how you can create powerful automation on any software project using GitHub’s platform. This session will cover GitHub Actions, GitHub Copilot, and GitHub Codespaces. At the end of the session, you may even receive a free GitHub certification voucher.*

*Offer good only while supplies last. Limit one GitHub voucher per person. This offer is non-transferable and cannot be combined with any other offer. This offer ends on June 27, 2024 or while supplies last, and is not redeemable for cash. Taxes, if any, are the sole responsibility of the recipient. Microsoft reserves the right to cancel, change, or suspend this offer at any time without notice.

Full series information

Follow on Microsoft Learn:

• Complete the Learn module

• Complete the Learn module (2)

• Complete the Learn module (3)

Learning objectives:

• Write code using GitHub Copilot, an AI assistant

• Build automation with GitHub Actions

• Use GitHub Codespaces for configuring projects

Presenters:

Alfredo Deza (LinkedIn)

Principal Cloud Advocate - Microsoft

Abril Ureña (LinkedIn)

Cloud Advocate - Microsoft

Moderators:

Jessica Escobedo (LinkedIn)

Microsoft Student Ambassador

Find out how you can create powerful automation on any software project using GitHub’s platform. This session will cover GitHub Actions, GitHub Copilot, and GitHub Codespaces. At the end of the session, you may even receive a free GitHub certification voucher.*

*Offer good only while supplies last. Limit one GitHub voucher per person. This offer is non-transferable and cannot be combined with any other offer. This offer ends on June 27, 2024 or while supplies last, and is not redeemable for cash. Taxes, if any, are the sole responsibility of the recipient. Microsoft reserves the right to cancel, change, or suspend this offer at any time without notice.

Full series information

Follow on Microsoft Learn:

• Complete the Learn module

• Complete the Learn module (2)

• Complete the Learn module (3)

Learning objectives:

• Write code using GitHub Copilot, an AI assistant

• Build automation with GitHub Actions

• Use GitHub Codespaces for configuring projects

Presenters:

Alfredo Deza (LinkedIn)

Principal Cloud Advocate - Microsoft

Abril Ureña (LinkedIn)

Cloud Advocate - Microsoft

Moderators:

Jessica Escobedo (LinkedIn)

Microsoft Student Ambassador

Summary Agile methodologies have been adopted by a majority of teams for building software applications. Applying those same practices to data can prove challenging due to the number of systems that need to be included to implement a complete feature. In this episode Shane Gibson shares practical advice and insights from his years of experience as a consultant and engineer working in data about how to adopt agile principles in your data work so that you can move faster and provide more value to the business, while building systems that are maintainable and adaptable.

Announcements

Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Go to dataengineeringpodcast.com/linode today and get a $100 credit to launch a database, create a Kubernetes cluster, or take advantage of all of their other services. And don’t forget to thank them for their continued support of this show! Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Push information about data freshness and quality to your business intelligence, automatically scale up and down your warehouse based on usage patterns, and let the bots answer those questions in Slack so that the humans can focus on delivering real value. Go to dataengineeringpodcast.com/atlan today to learn more about how Atlan’s active metadata platform is helping pioneering data teams like Postman, Plaid, WeWork & Unilever achieve extraordinary things with metadata and escape the chaos. Prefect is the modern Dataflow Automation platform for the modern data stack, empowering data practitioners to build, run and monitor robust pipelines at scale. Guided by the principle that the orchestrator shouldn’t get in your way, Prefect is the only tool of its kind to offer the flexibility to write code as workflows. Prefect specializes in glueing together the disparate pieces of a pipeline, and integrating with modern distributed compute libraries to bring power where you need it, when you need it. Trusted by thousands of organizations and supported by over 20,000 community members, Prefect powers over 100MM business critical tasks a month. For more information on Prefect, visit dataengineeringpodcast.com/prefect. Data engineers don’t enjoy writing, maintaining, and modifying ETL pipelines all day, every day. Especially once they realize 90% of all major data sources like Google Analytics, Salesforce, Adwords, Facebook, Spreadsheets, etc., are already available as plug-and-play connectors with reliable, intuitive SaaS solutions. Hevo Data is a highly reliable and intuitive data pipeline platform used by data engineers from 40+ countries to set up and run low-latency ELT pipelines with zero maintenance. Boasting more than 150 out-of-the-box connectors that can be set up in minutes, Hevo also allows you to monitor and control your pipelines. You get: real-time data flow visibility, fail-safe mechanisms, and alerts if anything breaks; preload transformations and auto-schema mapping precisely control how data lands in your destination; models and workflows to transform data for analytics; and reverse-ETL capability to move the transformed data back to your business software to inspire timely action. All of this, plus its transparent pricing and 24*7 live support, makes it consistently voted by users as the Leader in the Data Pipeline category on review platforms like G2. Go to dataengineeringpodcast.com/hevodata and sign up for a free 14-day trial that also comes with 24×7 support. Your host is Tobias Macey and today I’m interviewing Shane Gibson about how to bring Agile practices to your data management workflows

Interview

Introduction How did you get involved in the area of data management? Can you describe what AgileData is and the story behind it? What are the main industries and/or use cases that you are focused on supporting? The data ecosystem has been trying on different paradigms from software development for some time now (e.g. DataOps, version control, etc.). What are the aspects of Agile that do and don’t map well to data engineering/analysis? One of the perennial challenges of data analysis is how to approach data modeling. How do you balance the need to provide value with the long-term impacts of incomplete or underinformed modeling decisions made in haste at the beginning of a project?

How do you design in affordances for refactoring of the data models without breaking downstream assets?

Another aspect of implementing data products/platforms is how to manage permissions and governance. What are the incremental ways that those principles can be incorporated early and evolved along with the overall analytical products? What are some of the organizational design strategies that you find most helpful when establishing or training a team who is working on data products? In order to have a useful target to work toward it’s necessary to understand what the data consumers are hoping to achieve. What are some of the challenges of doing requirements gathering for data products? (e.g. not knowing what information is available, consumers not understanding what’s hard vs. easy, etc.)

How do you work with the "customers" to help them understand what a reasonable scope is and translate that to the actual project stages for the engineers?

What are some of the perennial questions or points of confusion that you have had to address with your clients on how to design and implement analytical assets? What are the most interesting, innovative, or unexpected ways that you have seen agile principles used for data? What are the most interesting, unexpected, or challenging lessons that you have learned while working on AgileData? When is agile the wrong choice for a data project? What do you have planned for the future of AgileData?

Contact Info

LinkedIn @shagility on Twitter

Parting Question

From your perspective, what is the biggest gap in the tooling or technology for data management today?

Closing Announcements

Thank you for listening! Don’t forget to check out our other shows. Podcast.init covers the Python language, its community, and the innovative ways it is being used. The Machine Learning Podcast helps you go from idea to production with machine learning. Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes. If you’ve learned something or tried out a project from the show then tell us about it! Email [email protected]) with your story. To help other people find the show please leave a review on Apple Podcasts and tell your friends and co-workers

Links

AgileData OptimalBI How To Make Toast Data Mesh Information Product Canvas DataKitchen

Podcast Episode

Great Expectations

Podcast Episode

Soda Data

Podcast Episode

Google DataStore Unfix.work Activity Schema

Podcast Episode

Data Vault

Podcast Episode

Star Schema Lean Methodology Scrum Kanban

The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA

Sponsored By: Atlan:

Have you ever woken up to a crisis because a number on a dashboard is broken and no one knows why? Or sent out frustrating slack messages trying to find the right data set? Or tried to understand what a column name means?

Our friends at Atlan started out as a data team themselves and faced all this collaboration chaos themselves, and started building Atlan as an internal tool for themselves. Atlan is a collaborative workspace for data-driven teams, like Github for engineering or Figma for design teams. By acting as a virtual hub for data assets ranging from tables and dashboards to SQL snippets & code, Atlan enables teams to create a single source of truth for all their data assets, and collaborate across the modern data stack through deep integrations with tools like Snowflake, Slack, Looker and more.

Go to dataengineeringpodcast.com/atlan and sign up for a free trial. If you’re a data engineering podcast listener, you get credits worth $3000 on an annual subscription.Prefect:

Prefect is the modern Dataflow Automation platform for the modern data stack, empowering data practitioners to build, run and monitor robust pipelines at scale. Guided by the principle that the orchestrator shouldn’t get in your way, Prefect is the only tool of its kind to offer the flexibility to write code as workflows. Prefect specializes in glueing together the disparate pieces of a pipeline, and integrating with modern distributed compute libraries to bring power where you need it, when you need it. Trusted by thousands of organizations and supported by over 20,000 community members, Prefect powers over 100MM business critical tasks a month. For more information on Prefect, visit…