talk-data.com

From Plato’s world of forms to the geometry of snowflakes and the logic of living systems, math and computation seem to run through everything — but are they descriptions of reality, or ingredients of it? In this session, we’ll explore how Plato, Alan Turing, John von Neumann, Stephen Wolfram, and Michael Levin each approached the deep question of how form, function, and information intertwine. We’ll also ask: what can these perspectives teach us about how fragments become agents — how patterns in matter give rise to meaning, intention, and mind? Links to key readings and sources for discussion will be shared ahead of the event.

Join us for an open group discussion on technical editing 📝

Led by Michael Dodd (Technical Writer & Editor for GBG Plc), we will discuss and share our collective thoughts on:

• The collaborative nature of editing
• The mental shift required to review rather than produce new content
• The importance of asking for and accepting help

When: Thursday 20 June, from 6:30pm Where: Codat, 7 St Cross St, London EC1N 8UB What: 18.30 - 19.00 Arrival and light refreshments 19.00 - 19.30 Michael Dodd on the merits of technical editing 19.30 - 19.45 Short break 19.45 - 20.30 Open discussion/Activity with the audience 20.30 - 21.00 Closing and networking

How to find us: The main entrance to Codat's office is located in the courtyard of Johnson Gardens, off of St Cross Street.

Map pin \| what3words

Enter through the black metal gates and walk through the yard until you see the doors with the Codat logo, where you will be greeted by a friendly organiser.

Photos: Please note that the organizers may take some photos for the WTD group.

Summary Building and maintaining a data lake is a choose your own adventure of tools, services, and evolving best practices. The flexibility and freedom that data lakes provide allows for generating significant value, but it can also lead to anti-patterns and inconsistent quality in your analytics. Delta Lake is an open source, opinionated framework built on top of Spark for interacting with and maintaining data lake platforms that incorporates the lessons learned at DataBricks from countless customer use cases. In this episode Michael Armbrust, the lead architect of Delta Lake, explains how the project is designed, how you can use it for building a maintainable data lake, and some useful patterns for progressively refining the data in your lake. This conversation was useful for getting a better idea of the challenges that exist in large scale data analytics, and the current state of the tradeoffs between data lakes and data warehouses in the cloud.

Announcements

Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. With 200Gbit private networking, scalable shared block storage, and a 40Gbit public network, you’ve got everything you need to run a fast, reliable, and bullet-proof data platform. If you need global distribution, they’ve got that covered too with world-wide datacenters including new ones in Toronto and Mumbai. And for your machine learning workloads, they just announced dedicated CPU instances. Go to dataengineeringpodcast.com/linode today to get a $20 credit and launch a new server in under a minute. And don’t forget to thank them for their continued support of this show! And to keep track of how your team is progressing on building new pipelines and tuning their workflows, you need a project management system designed by engineers, for engineers. Clubhouse lets you craft a workflow that fits your style, including per-team tasks, cross-project epics, a large suite of pre-built integrations, and a simple API for crafting your own. With such an intuitive tool it’s easy to make sure that everyone in the business is on the same page. Data Engineering Podcast listeners get 2 months free on any plan by going to dataengineeringpodcast.com/clubhouse today and signing up for a free trial. Support the show and get your data projects in order! You listen to this show to learn and stay up to date with what’s happening in databases, streaming platforms, big data, and everything else you need to know about modern data management. For even more opportunities to meet, listen, and learn from your peers you don’t want to miss out on this year’s conference season. We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference. Coming up this fall is the combined events of Graphorum and the Data Architecture Summit. The agendas have been announced and super early bird registration for up to $300 off is available until July 26th, with early bird pricing for up to $200 off through August 30th. Use the code BNLLC to get an additional 10% off any pass when you register. Go to dataengineeringpodcast.com/conferences to learn more and take advantage of our partner discounts when you register. Go to dataengineeringpodcast.com to subscribe to the show, sign up for the mailing list, read the show notes, and get in touch. To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Your host is Tobias Macey and today I’m interviewing Michael Armbrust about Delta Lake, an open source storage layer that brings ACID transactions to Apache Spark and big data workloads.

Interview

Introduction How did you get involved in the area of data m

Plug Yourself In with the Ultimate Guide to the Internet! EXHAUSTIVE INDEX: An exhaustive index with thorough cross-references helps you find exactly what you want, quickly and easily. INTERNATIONAL COVERAGE: International coverage makes your discoveries on the Web virtually limitless. SEARCH SECRETS: Michael Miller, along with Mikal Belicove and Joe Kraynak, have written the foreward that gets you up to speed on searching the Internet, blocking pop-up ads, protecting children online, accessing the wireless Web, plugging in to podcasts and webcasts, and reading fascinating weblogs (blogs). Use This Complete Guide to Web Surfing at Its Best: • Find new job opportunities • Find information and resources on all aspects of adoption • Download music from your favorite artists • Get tips, strategies, and information on improving your poker game • Get free technical support for your PC or Mac • Learn the ancient Chinese art of Feng Shui • Find sites devoted to men’s and women’s health and related issues Category Internet–Directories Covers The Internet and the World Wide Web User Level All In this Edition Icons identify unique information about each listed website BEST OF THE BEST This icon identifies THE best website in any given category. If you have time to visit only one site in a category, look for the Best of the Best! KID ICON The child-rating icon is designed to help you weed out sites that are inappropriate for children. BLOG ICON The blog icon identifies those sites that allow visitors to post comments and are interactive. PODCAST The Podcast icon identifies sites that provide audio-on-the-go content. WEBCAST The webcast icon identifies those sites that feature dynamic audio-visual content RSS FEED ICON The RSS Feed icon indicates, quickly and easily, those sites that offer live feeds in any given category. DIRECTORY ICON The Directory icon indicates websites that may not provide a lot of quality information on their own but instead point you to the best sites that deal with a particular topic. QUALITY INDICATOR The quality indicator icon rates sites on a scale of 1 to 5 based on content, appearance, and ease of use. Look for a ranking of 5 and you’ve found the most user-friendly sites. 789736292 100307