talk-data.com

Venue: Carnival House, 100 Harbour Parade, Southampton, SO15 1ST 📢 Want to speak 📢: submit your talk proposal

Please note:

1. 🚨🚨🚨A valid photo ID is required by building security. You MUST use your initial/first name and surname on your meetup profile, otherwise, you will NOT make it on the guest list! 🚨🚨🚨
2. This event follows the NumFOCUS Code of Conduct, please familiarise yourself with it before the event.

If your RSVP status says "You're going" you will be able to get in. No further confirmation required. You will NOT need to show your RSVP confirmation when signing in. If you can no longer make it, please unRSVP as soon as you know so we can assign your place to someone on the waiting list.

*** Code of Conduct: This event follows the NumFOCUS Code of Conduct, please familiarise yourself with it before the event. Please get in touch with the organisers with any questions or concerns regarding the Code of Conduct. *** There will be pizza & drinks, generously provided by our host, Carnival UK. ***

Mastering Data Flow: Prefect Pipelines Workshop - Adam Hill & Chris Frohmaier Join us for an engaging workshop where we'll dive deep into the world of data engineering with Prefect 3. Throughout the session, participants will explore the following key topics:

• Overview of Prefect and its core features
• Understanding the Prefect ecosystem and its integration with popular data science tools
• Setting up a Prefect environment: Installation, configuration, and project setup

Building Data Pipelines:

• Data ingestion: Fetching data from various sources including RSS feeds, APIs, and databases
• Data transformation and manipulation using Prefect tasks and flows
• Data storage and persistence: Storing processed data into local databases such as MongoDB or SQL
• Integrating machine learning models for advanced data processing and analysis within Prefect workflows

Advanced Techniques and Best Practices:

• Implementing error handling and retry strategies for fault tolerance and reliability
• Exploring Prefect's advanced features such as parallel execution, versioning, and dependency management

By the end of the workshop, attendees will have gained a comprehensive understanding of Prefect 3 and its capabilities, empowering them to design, execute, and optimise data pipelines efficiently in real-world scenarios.

We invite you to join us on this exciting journey of mastering data flows with Prefect!

Instructions to prepare in advance Workshop Materials and Requirements: In advance of the workshop please visit the github repo here: https://github.com/Cadarn/PyData-Prefect-Workshop. Clone a copy of the repository and follow the setup instructions in the README file including:

• Setting up a new Python environment with all the required modules
• Installing Docker and Docker Compose if necessary and then running the docker compose file so that local copies of the software images are downloaded in advance.
• Create a free MongoDB Atlas account and setup a project/database for the workshop

Please follow the instructions in advance of attending the workshop/

Please note this is a practical session and you will need to bring your own laptop. We recommend you bring it fully charged, if you can, as there may not be enough plug sockets for everyone to use at the same time.

Logistics Doors open at 6.30 pm, talks start at 7 pm. For those who wish to continue networking and chatting we will move to a nearby pub/bar for drinks from 9 pm.

Please unRSVP in good time if you realise you can't make it. We're limited by building security on the number of attendees, so please free up your place for your fellow community members!

Follow @pydatasoton (https://twitter.com/pydatasoton) for updates and early announcements. We are also on Instagram/Threads as @pydatasoton; and find us on LinkedIn.