talk-data.com
People (59 results)
See all 59 →
Activities & events
| Title & Speakers | Event |
|---|---|
|
The Future is Open: Data Streaming in an Omni-Cloud Reality
2023-07-27 · 23:53
This session begins with data warehouse trivia and lessons learned from production implementations of multicloud data architecture. You will learn to design future-proof low latency data systems that focus on openness and interoperability. You will also gain a gentle introduction to Cloud FinOps principles that can help your organization reduce compute spend and increase efficiency. Most enterprises today are multicloud. While an assortment of low-code connectors boasts the ability to make data available for analytics in real time, they post long-lasting challenges:
The alternative is an open data lake that unifies batch and streaming workloads. Bronze landing zones in open format eliminate the data extraction costs required by proprietary EDW. Apache Spark™ Structured Streaming provides a unified ingestion interface. Streaming triggers allow us to switch back and forth between batch and stream with one-line code changes. Streaming aggregation enables us to incrementally compute on data that arrives near each other. Specific examples are given on how to use Autoloader to discover newly arrived data and ensure exactly once, incremental processing. How DLT can be configured effectively to further simplify streaming jobs and accelerate the development cycle. How to apply SWE best practices to Workflows and integrate with popular Git providers, either using the Databricks Project or Databricks Terraform provider. Talk by: Christina Taylor Here’s more to explore: Big Book of Data Engineering: 2nd Edition: https://dbricks.co/3XpPgNV The Data Team's Guide to the Databricks Lakehouse Platform: https://dbricks.co/46nuDpI Connect with us: Website: https://databricks.com Twitter: https://twitter.com/databricks LinkedIn: https://www.linkedin.com/company/databricks Instagram: https://www.instagram.com/databricksinc Facebook: https://www.facebook.com/databricksinc |
Databricks DATA + AI Summit 2023 |
|
[Replay] Al and Scott Taylor discuss making data fun and simple in data management
2022-03-23 · 10:00
Scott Taylor
– Data Whisperer
@ Metametacon Consulting
,
Al Martin
– WW VP Technical Sales
@ IBM
Send us a text Want to be featured as a guest on Making Data Simple? Reach out to us at [[email protected]] and tell us why you should be next. Abstract Making Data Simple Podcast is hosted by Al Martin, WW VP Account Technical Leader IBM Technology Sales, where we explore trending technologies, business innovation, and leadership ... while keeping it simple & fun. This week on Making Data Simple, we have Scott Taylor. Scott is the Data Whisperer, a thought leader, consultant on the strategic value of data management, Principal Consultant of MetaMeta Consulting and he practices data evangelism as a service. Scott discusses helping people understand the value and strategic importance of simple data. Show Notes 1:25 – Scott’s back ground 4:30 – Does Scott talk to data? 5:20 – How long has Scott been in data? 6:50 - Data Management 13:12 - Data Story telling 17:05 – Structured data 25:08 - Core manifesto 25:48 – Bad data ideas Connect with Scott Taylor Scott Taylor - LinkedIn Scott Taylor - Twitter Scott Taylor – The Data Whisperer YouTube channel Connect with the Team Producer Kate Brown - LinkedIn. Producer Steve Templeton - LinkedIn. Host Al Martin - LinkedIn and Twitter. Want to be featured as a guest on Making Data Simple? Reach out to us at [email protected] and tell us why you should be next. The Making Data Simple Podcast is hosted by Al Martin, WW VP Technical Sales, IBM, where we explore trending technologies, business innovation, and leadership ... while keeping it simple & fun. |
Making Data Simple |
|
Taylor Murphy
– guest
,
Douwe Maan
– Project Lead
@ Meltano
,
AJ Steers
– guest
,
Tobias Macey
– host
Summary Data integration in the form of extract and load is the critical first step of every data project. There are a large number of commercial and open source projects that offer that capability but it is still far from being a solved problem. One of the most promising community efforts is that of the Singer ecosystem, but it has been plagued by inconsistent quality and design of plugins. In this episode the members of the Meltano project share the work they are doing to improve the discovery, quality, and capabilities of Singer taps and targets. They explain their work on the Meltano Hub and the Singer SDK and their long term goals for the Singer community. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform. Go to dataengineeringpodcast.com/linode today and get a $100 credit to try out a Kubernetes cluster of your own. And don’t forget to thank them for their continued support of this show! Are you bored with writing scripts to move data into SaaS tools like Salesforce, Marketo, or Facebook Ads? Hightouch is the easiest way to sync data into the platforms that your business teams rely on. The data you’re looking for is already in your data warehouse and BI tools. Connect your warehouse to Hightouch, paste a SQL query, and use their visual mapper to specify how data should appear in your SaaS systems. No more scripts, just SQL. Supercharge your business teams with customer data using Hightouch for Reverse ETL today. Get started for free at dataengineeringpodcast.com/hightouch. Atlan is a collaborative workspace for data-driven teams, like Github for engineering or Figma for design teams. By acting as a virtual hub for data assets ranging from tables and dashboards to SQL snippets & code, Atlan enables teams to create a single source of truth for all their data assets, and collaborate across the modern data stack through deep integrations with tools like Snowflake, Slack, Looker and more. Go to dataengineeringpodcast.com/atlan today and sign up for a free trial. If you’re a data engineering podcast listener, you get credits worth $3000 on an annual subscription Your host is Tobias Macey and today I’m interviewing Douwe Maan, Taylor Murphy, and AJ Steers about their work to level up the Singer ecosystem through projects like Meltano Hub and the Singer SDK Interview Introduction How did you get involved in the area of data management? Can you start by describing what the Singer ecosystem is? What are the current weak points/challenges in the ecosystem? What is the current role of the Meltano project/community within the ecosystem? What are the projects and activities related to Singer that you are focused on? What are the main goals of the Meltano Hub? What criteria are you using to determine which projects to include in the hub? Why is the number of targets so small? What additional functionality do you have planned for the hub? What functionality does the SDK provide? How does the presence of the SDK make it easier to write taps/targets? What do you believe the long-term impacts of the SDK on the overall availability and quality of plugins will be? Now that you have spun out your own business and raised funding, how does that influence the priorities and focus of your work? How do you hope to productize what you have built at Meltano? What are the most interesting, innovative, or unexpected ways that you have seen Meltano and Singer plugins used? What are |
Data Engineering Podcast |
|
Scott discusses making data fun and simple in data management.
2020-08-26 · 10:00
Scott Taylor
– Data Whisperer
@ Metametacon Consulting
,
Al Martin
– WW VP Technical Sales
@ IBM
Send us a text Want to be featured as a guest on Making Data Simple? Reach out to us at [[email protected]] and tell us why you should be next. Abstract Hosted by Al Martin, VP, Data and AI Expert Services and Learning at IBM, Making Data Simple provides the latest thinking on big data, A.I., and the implications for the enterprise from a range of experts. This week on Making Data Simple, we have Scott Taylor. Scott is the Data Whisperer, a thought leader, consultant on the strategic value of data management, Principal Consultant of MetaMeta Consulting and he practices data evangelism as a service. Scott discusses helping people understand the value and strategic importance of simple data. Show Notes 1:25 – Scott’s back ground 4:30 – Does Scott talk to data? 5:20 – How long has Scott been in data? 6:50 - Data Management 13:12 - Data Story telling 17:05 – Structured data 25:08 - Core manifesto 25:48 – Bad data ideas Connect with Scott Taylor Scott Taylor - LinkedIn Scott Taylor - Twitter Scott Taylor – The Data Whisperer YouTube channel Connect with the Team Producer Kate Brown - LinkedIn. Producer Steve Templeton - LinkedIn. Host Al Martin - LinkedIn and Twitter. Want to be featured as a guest on Making Data Simple? Reach out to us at [email protected] and tell us why you should be next. The Making Data Simple Podcast is hosted by Al Martin, WW VP Technical Sales, IBM, where we explore trending technologies, business innovation, and leadership ... while keeping it simple & fun. |
Making Data Simple |
|
Tool, Metal’s Growth, and the Future of the Album
2019-09-11 · 04:00
Jason Joven
– host
@ Chartmetric
Highlights When was the last time you got your face melted with some heavy metal? Well, distributor TuneCore says it was probably during 2018 and American alt-metal group Tool says it’s right now on the Billboard 200 chart.Mission Good morning, it’s Jason here at Chartmetric with your 3-minute Data Dump where we upload charts, artists and playlists into your brain so you can stay up on the latest in the music data world.Chartmetric’s social media handle is Chartmetric, no “S ”- follow us on LinkedIn, Instagram, Twitter, and Facebook- we’re always posting cool music tidbits for your knowledge! And here’s more.DateThis is your Data Dump for Wednesday, Sept. 11, 2019.Tool, Metal’s Growth, and the Future of the AlbumYesterday, digital distributor TuneCore released some Q1 2019 statistics stating that $83M USD was earned by its artists, bringing their total distribution revenue to over $1.5B all-time.However, one of its finer details caught the eye of some music outlets like Consequence of Sound: the Heavy metal genre sported a 154% increase in streams and downloads in 2018, outdoing the next four genres J-Pop at a 133%, R&B/Soul at 68% and K-Pop at 58%.While the 2018 data might feel a little outdated, how about this week of September 14th, when American alternative metal band Tool debuted in the #1 Billboard 200 album chart like they were a Billie Eilish / Drake super-group. Tool’s new album “Fear Inoculum” breaks all of the pop and hip-hop’s rules, as it was 13 years in the making for the progressive metal act and according to Billboard:“...a now-rare example of a No. 1 album without…” a concert redemption offer, pre-order promotion, or merchandise bundle.Tool amazingly relegated Taylor Swift’s “Lover” album to the #2 slot on the Billboard chart, and the band is currently ranked 679th overall according to Chartmetric’s Cross-Platform Performance ranking as of yesterday.Tool’s Neighboring Artists who are ranked similarly include Reggaeton artist Arcangel, Pop crooner Alec Benjamin and Rap duo Rae Sremmurd.Now given Tool’s smashing album success this week, you’d expect to see them similarly trouncing their fellow artists with similar music metrics.However, the opposite is the case: Tool only wields 830K Spotify followers, while Rae Sremmurd has over 5.1M and Arcangel has over 3.8M.Similarly, both artists also trounce Tool with regard to Spotify Monthly Listeners -- the rap and reggaeton stars are collecting almost 11M unique streamers on the Swedish platform while Tool only has half that.But that’s why it’s important to take into account more hits-driven artists vs. album-driven artists: Tool’s fans have long known they don’t go by industry rules and that’s part of why they love them.Six of the new album’s ten tracks clock in over 10 minutes each and the packaged CD released with a 4-inch HD screen inside of it to play its visual arts-driven music videos to their fans that bought it.So while no single Tool songs are appearing on Apple Music or Amazon track charts, the album sits at No. 14 on Apple’s Album charts and leading their Rock one. They also take No. 17 on Amazon’s Album charts and No. 1 on its Rock chart.This breaks the normal correlation between each platform’s track and album charts...which just goes to show that Tool is doing things their way, in a big way.As most music markets continue to digitize away from the physical world, Tool is showing that while the album format still has its charms, they are likely also benefitting from a rising tide where metal fans are digitizing themselves.Outro That’s it for your Daily Data Dump for Wednesday, Sept. 11, 2019. This is Jason from Chartmetric.Free accounts are available at chartmetric.com And article links and show notes are at: podcast.chartmetric.comHappy Wednesday, and we’ll see you on Friday! |
|
|
Data Predictions for the 2019 MTV Video Music Awards (VMAs)
2019-07-24 · 04:00
Jason Joven
– host
@ Chartmetric
Highlights The MTV Video Music Awards are back for 2019 and the ballots are open! We’ll take a look at who’s up for what and from a data perspective, who might win!Mission Good morning, it’s Jason here at Chartmetric with your 3-minute Data Dump where we upload charts, artists and playlists into your brain so you can stay up on the latest in the music data world.We’re on the socials at “chartmetric”, that’s Chartmetric, no “S ”- follow us on LinkedIn, Instagram, Twitter, or Facebook, and talk to us! We’d love to hear from you.DateThis is your Data Dump for Wednesday, July 24th, 2019.VMAsThe 2019 MTV Video Music Awards take place in New Jersey’s Prudential Center on Aug 26th.Started in 1984, the 36th installment of the annual ceremony will continue to draw together the music industry’s brightest stars, and their biggest fans, to celebrate the music video medium.Voting for performer categories have been open to the public since 2006, and for 2019, the virtual ballots will be open until Aug. 15.Looking at the artists with the most nominations, the data is very clear that the ceremony is about the biggest stars today:Coming out with 10 nominations each are Ariana Grande and Taylor Swift, Billie Eilish with 9 and Lil Nas X with 8. This is for the performer categories, of which there are 14, while professional category voting (such as Best Art Direction) are closed off to qualified personnel.All four of these artists have Spotify Popularity Indices higher than 92, Monthly Listener counts above 39M, and Chartmetric rankings of 20 or above.Interestingly, their YouTube subscriber counts vary widely, with Grande and Swift with 36M and 34M each, Eilish at 16M and Lil Nas X around 4.5M.Since subscriber count on YouTube reflects a long-term public interest in an artist, and to a certain degree, the seniority of any creator, it says something about how MTV nominates its artists, which seems to be a closed process.By nominating Grande and Swift the most, who have both been active since 2008 and 2004 respectively, it’s nodding to the more veteran players in the industry.But with Eilish and Lil Nas X, who have been active only since 2015 and 2018, it understandably shows the awards to also be a measurement who’s hot now.But who will win what? What are your predictions, Chartmetric?Well, we can’t say for sure, but what we can do is pretend certain metrics are the best predictors for each category.For example, if Video of the Year came down to straight YouTube views, Lil Nas X and Billy Ray Cyrus’ “Old Town Road (Remix)” would leave everyone else in the dust at 551M views, several steps ahead of the #2 runner up, which would be Eilish’s “bad guy” at 406M.If Song of the Year came down to Spotify Monthly Listeners, then it’d be (surprise, surprise) Lil Nas X again at 48M and then Drake as runner-up with 45M.Finally, if Artist of the Year came down to Chartmetric’s Cross-Platform Performance ranking, then the winner would be Shawn Mendes, who’s ranked #3 in our systems, with Ariana coming in 2nd in the MTV category with an 11th Chartmetric CPP ranking.But who knows which artists the people will vote for next month, we’ll just have to tune in and see!Outro That’s it for your Daily Data Dump for Wednesday, July 24th 2019. This is Jason from Chartmetric.Free accounts are at chartmetric.comAnd article links and show notes are at: podcast.chartmetric.comHappy Wednesday, and we’ll see you Friday! |
|