talk-data.com

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/8516989305441/WN_0yBk9PXxRI2yivjj2aGRUA

Delivering high-quality data products requires strict testing of pipelines before deploying them into production. Today, in order to test ETLs, one either needs to use a subset of the data, or is forced to create multiple copies of the entire data. Testing against sample data is not good enough. The alternative, however, is costly and time consuming.

In this webinar we will demonstrate how to develop and test on the entire production data set with zero-copy using the open source solution lakeFS.

Agenda:

(PST) 11:45 am - 11:50 am Arrival, socializing, and Opening (PST) 11:50 am - 1:45 pm Iddo Avneri, "Testing Data Pipelines at Scale: lakeFS for Zero-Copy Testing" (PST) 1:45 pm - 1:50 pm Q&A

About Iddo Avneri:

Iddo Avneri has had a long and varied career in the technology industry. Iddo began their career in 1998 as a Trainer at the IDF Programming School, where they trained the course after completing it with honors. In 2001, they became Head of the Software and Elearning Department for the IDF, where they were in charge of 7 officers and 30 trainers, as well as project management for programming course development. In 2006, they joined OpTier as Director of Presales Technical, where they were responsible for all company proof of concepts and supporting the sales process from early engagements through scoping a pilot and delivering the value needed for the customer. In 2013, they were promoted to VP of Pre-sales and Post-sales at OpTier, which was acquired by SAP. Iddo then joined Turbonomic in 2014, where they were CTO of Financial Services and VP of Presales. In 2021, they joined Treeverse - the company behind lakeFS - as VP of Customer Success. Iddo Avneri obtained a BA in Computer Science and Management from Israel Jobs between 2002 and 2006. Prior to this, they completed a computer technician course from Mahat in 2001, and a programmer course from Mamram - IDF in 1998. Iddo also attended BSMH, although no degree or field of study is specified.

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/8516989305441/WN_0yBk9PXxRI2yivjj2aGRUA

Webinar Passcode 463808

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/8516989305441/WN_0yBk9PXxRI2yivjj2aGRUA

Delivering high-quality data products requires strict testing of pipelines before deploying them into production. Today, in order to test ETLs, one either needs to use a subset of the data, or is forced to create multiple copies of the entire data. Testing against sample data is not good enough. The alternative, however, is costly and time consuming.

In this webinar we will demonstrate how to develop and test on the entire production data set with zero-copy using the open source solution lakeFS.

Agenda:

(PST) 11:45 am - 11:50 am Arrival, socializing, and Opening (PST) 11:50 am - 1:45 pm Iddo Avneri, "Testing Data Pipelines at Scale: lakeFS for Zero-Copy Testing" (PST) 1:45 pm - 1:50 pm Q&A

About Iddo Avneri:

Iddo Avneri has had a long and varied career in the technology industry. Iddo began their career in 1998 as a Trainer at the IDF Programming School, where they trained the course after completing it with honors. In 2001, they became Head of the Software and Elearning Department for the IDF, where they were in charge of 7 officers and 30 trainers, as well as project management for programming course development. In 2006, they joined OpTier as Director of Presales Technical, where they were responsible for all company proof of concepts and supporting the sales process from early engagements through scoping a pilot and delivering the value needed for the customer. In 2013, they were promoted to VP of Pre-sales and Post-sales at OpTier, which was acquired by SAP. Iddo then joined Turbonomic in 2014, where they were CTO of Financial Services and VP of Presales. In 2021, they joined Treeverse - the company behind lakeFS - as VP of Customer Success. Iddo Avneri obtained a BA in Computer Science and Management from Israel Jobs between 2002 and 2006. Prior to this, they completed a computer technician course from Mahat in 2001, and a programmer course from Mamram - IDF in 1998. Iddo also attended BSMH, although no degree or field of study is specified.

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/8516989305441/WN_0yBk9PXxRI2yivjj2aGRUA

Webinar Passcode 463808

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/4916959091064/WN_ja_vldDDQiehCsSBJNGgSQ

Troubleshooting and fixing failed ETL jobs is a manual error-prone process. The long time it takes to troubleshoot these failed jobs makes the task of ensuring the integrity and availability of data for downstream applications extremely difficult. An effective way to enable fast recovery in case of failed ETLs is to revert the production data to a consistent state - the state before the failure happened - for improved data availability.

We will be leveraging the open source project lakeFS to track data versions across dag execution at scale for isolated dag executions and quick recovery in case of errors.

Agenda:

(PDT) 11:45 am - 11:50 am Arrival, socializing, and Opening (PDT) 11:50 am - 1:45 pm Iddo Avneri, "Reproduce and Troubleshoot data in Airflow DAGs" (PDT) 1:45 pm - 1:50 pm Q&A

About Iddo Avneri:

Iddo Avneri has had a long and varied career in the technology industry. Iddo began their career in 1998 as a Trainer at the IDF Programming School, where they trained the course after completing it with honors. In 2001, they became Head of the Software and Elearning Department for the IDF, where they were in charge of 7 officers and 30 trainers, as well as project management for programming course development. In 2006, they joined OpTier as Director of Presales Technical, where they were responsible for all company proof of concepts and supporting the sales process from early engagements through scoping a pilot and delivering the value needed for the customer. In 2013, they were promoted to VP of Pre-sales and Post-sales at OpTier, which was acquired by SAP. Iddo then joined Turbonomic in 2014, where they were CTO of Financial Services and VP of Presales. In 2021, they joined Treeverse - the company behind lakeFS - as VP of Customer Success. Iddo Avneri obtained a BA in Computer Science and Management from Israel Jobs between 2002 and 2006. Prior to this, they completed a computer technician course from Mahat in 2001, and a programmer course from Mamram - IDF in 1998. Iddo also attended BSMH, although no degree or field of study is specified.

https://us02web.zoom.us/webinar/register/4916959091064/WN_ja_vldDDQiehCsSBJNGgSQ

Webinar Passcode 411424

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/4916959091064/WN_ja_vldDDQiehCsSBJNGgSQ

Troubleshooting and fixing failed ETL jobs is a manual error-prone process. The long time it takes to troubleshoot these failed jobs makes the task of ensuring the integrity and availability of data for downstream applications extremely difficult. An effective way to enable fast recovery in case of failed ETLs is to revert the production data to a consistent state - the state before the failure happened - for improved data availability.

We will be leveraging the open source project lakeFS to track data versions across dag execution at scale for isolated dag executions and quick recovery in case of errors.

Agenda:

(PDT) 11:45 am - 11:50 am Arrival, socializing, and Opening (PDT) 11:50 am - 1:45 pm Iddo Avneri, "Reproduce and Troubleshoot data in Airflow DAGs" (PDT) 1:45 pm - 1:50 pm Q&A

About Iddo Avneri:

Iddo Avneri has had a long and varied career in the technology industry. Iddo began their career in 1998 as a Trainer at the IDF Programming School, where they trained the course after completing it with honors. In 2001, they became Head of the Software and Elearning Department for the IDF, where they were in charge of 7 officers and 30 trainers, as well as project management for programming course development. In 2006, they joined OpTier as Director of Presales Technical, where they were responsible for all company proof of concepts and supporting the sales process from early engagements through scoping a pilot and delivering the value needed for the customer. In 2013, they were promoted to VP of Pre-sales and Post-sales at OpTier, which was acquired by SAP. Iddo then joined Turbonomic in 2014, where they were CTO of Financial Services and VP of Presales. In 2021, they joined Treeverse - the company behind lakeFS - as VP of Customer Success. Iddo Avneri obtained a BA in Computer Science and Management from Israel Jobs between 2002 and 2006. Prior to this, they completed a computer technician course from Mahat in 2001, and a programmer course from Mamram - IDF in 1998. Iddo also attended BSMH, although no degree or field of study is specified.

https://us02web.zoom.us/webinar/register/4916959091064/WN_ja_vldDDQiehCsSBJNGgSQ

Webinar Passcode 411424

Learn how to simplify the management of a data lake by enabling git-like operations over files in object storage. See how experimenting, reproducing data, and guaranteeing data quality are simplified and is all possible to achieve through open source tooling.

Please register using the zoom link to get a reminder:

https://us02web.zoom.us/webinar/register/3716921325642/WN_jiqsqNDfRzmMwNBg5nxcHw

The first problem faced with big data was the feasibility of processing data at such a high scale. In solving the scale problem, people developed technologies we know today like Kafka, Spark, Presto, Snowflake, and many others powering big data operations today. Now the problem people face is one of manageability. People no longer ask if they can handle a dataset but rather: How can I move faster when developing data-intensive applications? How do I utilize all of my data and ensure it is high-quality? Learn how to simplify the management of a data lake by enabling git-like operations over files in object storage. See how experimenting, reproducing data, and guaranteeing data quality are simplified and is all possible to achieve through open source tooling.

Agenda:

11:45 am - 11:50 am Arrival, socializing, and Opening 11:50 am - 1:45 pm Iddo Avneri, "A Git-Like Repository For Your Data Lake" 1:45 pm - 1:50 pm Q&A

About Iddo Avneri:

Iddo Avneri has had a long and varied career in the technology industry. Iddo began their career in 1998 as a Trainer at the IDF Programming School, where they trained the course after completing it with honors. In 2001, they became Head of the Software and Elearning Department for the IDF, where they were in charge of 7 officers and 30 trainers, as well as project management for programming course development. In 2006, they joined OpTier as Director of Presales Technical, where they were responsible for all company proof of concepts and supporting the sales process from early engagements through scoping a pilot and delivering the value needed for the customer. In 2013, they were promoted to VP of Pre-sales and Post-sales at OpTier, which was acquired by SAP. Iddo then joined Turbonomic in 2014, where they were CTO of Financial Services and VP of Presales. In 2021, they joined Treeverse - the company behind lakeFS - as VP of Customer Success. Iddo Avneri obtained a BA in Computer Science and Management from Israel Jobs between 2002 and 2006. Prior to this, they completed a computer technician course from Mahat in 2001, and a programmer course from Mamram - IDF in 1998. Iddo also attended BSMH, although no degree or field of study is specified.

https://us02web.zoom.us/webinar/register/3716921325642/WN_jiqsqNDfRzmMwNBg5nxcHw

Webinar Passcode 114302