Join us on May 6th at 5 PM at the Elastic NYC office for an exciting meetup about IoT, automation, cloud infrastructure, and more.

Agenda 5:00 pm - Doors open, say hi, grab some food 5:30 pm - Talk 1 by Nick Hehr 6:00 pm - Q&A with Nick 6:15 pm - break 6:30 pm - Talk 2 by Artem Nikitin 6:50 pm - Q&A with Artem Nikitin 7:00 pm - event wrap-up

Talk 1: "Physical world monitoring and automation with Elastic and Viam"

Traditional monitoring tools struggle to handle the volume, velocity, and variety of data generated by connected devices and machines. Using Elastic and Viam, we can build intelligent, automated systems that bridge the gap between the digital and physical world. Join us for a demonstration of gathering data from a fleet of sensors, visualizing it with Kibana, querying it using natural language, and creating alerting rules that trigger in real life.

Presented by Nick Hehr, Senior Dev Advocate at Viam.

Talk 2: How We're Building Elastic Cloud: Day-to-Day Stories from the Team Behind It

This talk won't focus on a shiny new Elasticsearch feature or the latest beautiful visualization in Kibana. Instead, I'll take you behind the scenes and share how we're building and operating Elastic Cloud services spanning 4 cloud providers, 58 regions, and over 20,000 instances. I'll cover the day-to-day work that keeps everything running smoothly: the challenges we face, the decisions we make, and the lessons we learn along the way.

Presented by Artem Nikitin, Principal Software Engineer I at Elastic

Where Elastic NEW Office 1250 Broadway, Floor 16, Training Room New York, NY 10001

Venue: Carnival House, 100 Harbour Parade, Southampton, SO15 1ST 📢 Want to speak 📢: submit your talk proposal

Please note:

1. 🚨🚨🚨A valid photo ID is required by building security. You MUST use your initial/first name and surname on your meetup profile, otherwise, you will NOT make it on the guest list! 🚨🚨🚨
2. This event follows the NumFOCUS Code of Conduct, please familiarise yourself with it before the event.

If your RSVP status says "You're going" you will be able to get in. No further confirmation required. You will NOT need to show your RSVP confirmation when signing in. If you can no longer make it, please unRSVP as soon as you know so we can assign your place to someone on the waiting list.

*** Code of Conduct: This event follows the NumFOCUS Code of Conduct, please familiarise yourself with it before the event. Please get in touch with the organisers with any questions or concerns regarding the Code of Conduct. *** There will be pizza & drinks, generously provided by our host, Carnival UK. ***

Main Talks 1️⃣ Combine geospatial data in 3D & beyond with TileDB arrays - Margriet Groenendijk Have you ever struggled with large amounts of geospatial data, huge volumes of files and many custom formats? Have you spent hours — even days — converting and wrangling disparate data formats and wondering how to combine data from different sources? Then this talk is for you! The solution? Forget about files or force-fitting geospatial data into tabular databases. Imagine a solution that naturally shape-shifts to the underlying data structure. TileDB is this solution: a multimodal database based on multi-dimensional arrays with which you can model any data type. TileDB is architected around a storage engine that uses arrays to store any data type, morphs into specialized analysis applications, supports a range of indexing options, and features an analysis-ready format designed for cloud object storage.

TileDB supports all geospatial data in a unified way with numerous APIs and integrates well with compute and visualization tools. TileDB has integrations with many tools that already exist within Python, such as Dask, Xarray, pandas, PDAL and GDAL. We also build interactive visualization tools with the BabylonJS gaming engine that streams geospatial data directly from TileDB arrays. This makes TileDB a natural fit for geospatial datasets!

When all your data fits naturally into your database's underlying data structures, it becomes much easier to work with. In this talk I will show examples of how to efficiently work with very large geospatial datasets. I will cover how to ingest, load, analyze and visualize all types of geospatial data and show how to combine and use them together.

2️⃣ Searching for gamma-ray sources in Space with GPU computing - Dr Alessandra Costantino Gamma-rays are high energy electromagnetic radiation, mainly produced in space, in objects like supernova explosions or black holes. Astrophysicists observe these celestial bodies, to try and understand how gamma-rays are produced in or around them.

Gamma-rays penetrate most materials, they can’t be observed with traditional telescope lenses, that focus light just like a regular camera would. In order to observe gamma rays, astronomers need to use large radiation detectors with thousands (or tens of thousands!) of pixels. The sources of gamma-rays can then be located by tracing back detections in each single pixel to the regions of the sky that could have generated its emission as the telescope is scanning the universe.

This is an intricate problem which requires considerable processing power. In this talk I will discuss how I approached this problem using the NVIDIA CUDA framework to access the computing power of graphical processing units (GPUs) and handle multiple detections at the same time.

Lightning Talks ⚡ ⚡1️⃣ Benchmarking Time-Series Databases - Nick Thorne ⚡2️⃣ census21api: a Python Interface to 2021 England and Wales Census Data - Michaela Lawrence

Logistics Doors open at 6.30 pm, talks start at 7 pm. For those who wish to continue networking and chatting we will move to a nearby pub/bar for drinks from 9 pm.

Please unRSVP in good time if you realise you can't make it. We're limited by building security on the number of attendees, so please free up your place for your fellow community members!

Follow @pydatasoton (https://twitter.com/pydatasoton) for updates and early announcements. We are also on Instagram/Threads as @pydatasoton; and find us on LinkedIn.

Today I’m joined by Nick Zervoudis, Data Product Manager at CKDelta. As we dive into his career and background, Nick shares insights into his approach when it comes to developing both internal and external data products. Nick explains why he feels that a software engineering approach is the best way to develop a product that could have multiple applications, as well as the unique way his team is structured to best handle the needs of both internal and external customers. He also talks about the UX design course he took, how that affected his data product work and research with users, and his thoughts on dashboard design. We discuss common themes he’s observed when data product teams get it wrong, and how he manages feelings of imposter syndrome in his career as a DPM. 

Highlights/ Skip to:

I introduce Nick, who is a Data Product Manager at CKDelta (00:35) Nick’s mindset around data products and how his early career in consulting shaped his approach (01:30) How Nick defines a data product and why he focuses more on the process rather than the end product (03:59) The types of data products that Nick has helped design and his work on both internal and external projects at CKDelta (07:57) The similarities and differences of working with internal versus external stakeholders (12:37) Nick dives into the details of the data products he has built and how they feed into complex use cases (14:21) The role that Nick plays in the Delta Power SaaS application and how the CKDelta team is structured around that product (17:14) Where Nick sees data products going wrong and how he’s found value in filling those gaps (23:30) Nick’s view on how a digital-first mindset affects the scalability of data products (26:15) Why Nick is often heavily involved in the design element of data product development and the course he took that helped shape his design work (28:55) The imposter syndrome that Nick has experienced when implementing this new strategy to data product design (36:51) Why Nick feels that figuring things out yourself is an inherent part of the DPM role (44:53) Nick shares the origins and information on the London Data Product Management meetup (46:08)

Quotes from Today’s Episode “What I’m always trying to do is see, how can we best balance the customer’s need to get exactly the data point or insight that they’re after to the business need. ... There’s that constant tug of war between customization and standardization that I have the joy of adjudicating. I think it’s quite fun.” — Nick Zervoudis (16:40)

“I’ve had times where I was hired, told, 'You’re going to be the product manager for this data product that we have,' as if it’s already, to some extent built and maybe the challenge is scaling it or bringing it to more customers or improving it, and then within a couple of weeks of starting to peek under the hood, realizing that this thing that is being branded a product is actually a bunch of projects hiding under a trench coat.” — Nick Zervoudis (24:04)

“If I just speak to five users because they’re the users, they’ll give me the insight I need. […] Even when you have a massive product with a huge user base, people face the same issues.” — Nick Zervoudis (33:49)

“For me, it’s more about making sure that you’re bringing that more software engineering way of building things, but also, before you do that, knowing that your users' needs are going to [be varied]. So, it’s a combination of both, are we building the right thing—in other words, a product that’s flexible enough to meet the different needs of different users—but also, are we building it in the right way?” – Nick Zervoudis (27:51)

“It’s not to say I’m the only person thinking about [UX design], but very often, I’m the one driving it.” – Nick Zervoudis (30:55)

“You’re never going to be as good at the thing your colleague does because their job almost certainly is to be a specialist: they’re an architect, they’re a designer, they’re a developer, they’re a salesperson, whereas your job [as a DPM] is to just understand it enough that you can then pass information across other people.” – Nick Zervoudis (41:12)

“Every time I feel like an imposter, good. I need to embrace that, because I need to be working with people that understand something better than me. If I’m not, then maybe something’s gone wrong there. That’s how I’ve actually embraced impostor syndrome.” – Nick Zervoudis (41:35)

Links CKDelta: https://www.ckdelta.ie LinkedIn: https://www.linkedin.com/in/nzervoudis/

Prepare your applications for the holiday shopping season by learning how to enhance their resilience.

In this session, we will provide an overview of app resiliency and discuss the importance of designing robust systems. We’ll cover an intro to Chaos engineering, which involves intentionally injecting failures to identify vulnerabilities and strengthen your application's resilience.

Connect with fellow developers and testers, learn essential practices, and ensure your applications are prepared to handle the holiday shopping season with confidence.

This is the sixth in a 7-part online series hosted by the Microsoft Reactor.

Learn more here-https://aka.ms/Azure-StudioPreview

Speaker BIO- Nick Trogh Nick is a technical writer at Microsoft, focusing on cloud testing and developer productivity services. Before this, he worked in developer relations, where he organized meetups, spoke at conferences, and helped developers do more with technology. Off work, you can find him cooking, traveling, or exploring the Belgian lowlands on a mountain bike.

Social Handle of the speaker LinkedIn- https://www.linkedin.com/in/nicktrogh/

Explore the seamless integration of Azure Load Testing with CI/CD pipelines and JMeter-based tests, ensuring your applications can handle the increased traffic and deliver optimal performance during the busiest time of the year.

Discover how to leverage the combined power of Azure Load Testing and JMeter-based tests to identify and address performance bottlenecks early in the development lifecycle. Learn best practices for integrating load testing into your CI/CD workflows with Azure DevOps and GitHub Actions, enabling continuous performance monitoring and improvement.

Join us to enhance your performance testing strategies, streamline your development processes, and ensure your applications are holiday-ready.

Skill Level - Intermediate

Further Learning: https://aka.ms/Quickstart-Loadtest-CI/CD

Speaker Bio: Nick Trogh

Nick is a technical writer at Microsoft, focusing on cloud testing and developer productivity services. Before this, he worked in developer relations, where he organized meetups, spoke at conferences, and helped developers do more with technology.

Off work, you can find him cooking, traveling, or exploring the Belgian lowlands on a mountain bike.

Social Handle: https://www.linkedin.com/in/nicktrogh/

ReactorBengaluru

This talk was recorded at Crunch Conference 2022. Nick from Transform spoke about metrics and semantics: an evolution in data consumption.

The event was organized by Crafthub.

You can watch the rest of the conference talks on our channel.

If you are interested in more speakers, tickets and details of the conference, check out our website: https://crunchconf.com/ If you are interested in more events from our company: https://crafthub.events/