Attending this event?
May 8 - 9, 2023 | Vancouver, Canada
View More Details & Registration

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for cdCon+GitOpsCon to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC -7). To see the schedule in your preferred timezone, please select from the drop-down menu to the right above "Filter by Date."
Back To Schedule
Tuesday, May 9 • 3:30pm - 4:00pm
CI/CD for Data - Building Dev/Test Data Environments with Open Source Stacks - Vinodhini Duraisamy, Treeverse

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Building a high quality software product is a breeze compared to building a high quality data product. Because software development being an evolved field has defined development best practices and the tools to implement these practices throughout the software lifecycle. On the contrary, most of the data teams have difficulty incorporating best practices like testing changes in isolation, reproducing a data error or rolling back in case of quality issues in production. With an ever-increasing number of organizations relying on data to make business decisions, the cost of data error in production is significantly higher too. Thus it becomes imperative for data teams to ensure the accuracy, resiliency and observability of data in production. So how does one go about extending software development best practices to data products? In this talk, you will learn about industry best practices for data lifecycle management and the open source tools such as Jenkins and lakeFS that help implement them.

avatar for Vinodhini Duraismy

Vinodhini Duraismy

Developer Advocate, Treeverse
Vino started as a software engineer at NetApp, and worked on data management applications for NetApp data centers when on-prem data centers were still a cool thing. She then hopped onto cloud and big data world and landed at the data teams of Nike and Apple. There she worked mainly... Read More →

Tuesday May 9, 2023 3:30pm - 4:00pm PDT
Meeting Room 217-219
  cdCon Sessions
Feedback form isn't open yet.