Search – talk-data.com

Title & Speakers	Event
Event London Reactor Meetup \| AI at Scale 2024-07-10
Lessons from setting up RAG systems in production to search over internal data and automate customer support 2024-07-10 · 19:10 Everyone has been crazy about Gen AI lately and yet few companies can say they derive measurable business value from Gen AI based solutions. I will go over two use cases and the journey to get them from an out-of-the-box RAG pipeline that kinda works in a demo to production quality systems that create value. The first use case is search over technical content such as documentation and developer forums. The second use case is automating ticket-based customer support. RAG production-ready systems internal data search customer support automation
Use an LLM on the tube with offline AI 2024-07-10 · 18:40 We've all got used to using LLMs in our developer workflow - from asking ChatGPT what tools and libraries to use, to getting GitHub copilot to generate code for us. Great when you are online, but not so useful when you are offline, like on the tube or in a plane with no WiFi. But what if there was another way? In this session, Jim will introduce offline LLMs. We'll look at how you can run LLMs locally, such as Phi-2 from Microsoft, and add these to your developer workflow. We'll compare the performance of offline vs online, both the speed and quality, but also touch on privacy and other considerations. We'll also look at hardware requirements as we don't all have the latest GPUs to hand. offline llm local deployment privacy considerations phi-2

We've all got used to using LLMs in our developer workflow - from asking ChatGPT what tools and libraries to use, to getting GitHub copilot to generate code for us. Great when you are online, but not so useful when you are offline, like on the tube or in a plane with no WiFi. But what if there was another way? In this session, Jim will introduce offline LLMs. We'll look at how you can run LLMs locally, such as Phi-2 from Microsoft, and add these to your developer workflow. We'll compare the performance of offline vs online, both the speed and quality, but also touch on privacy and other considerations. We'll also look at hardware requirements as we don't all have the latest GPUs to hand.

Activities & events