Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Data Science and Design: A Tale of Two Tribes
Gold
Wednesday, May 13, 2015 • Enterprise UX 2015
Share the love for this talk
Data Science and Design: A Tale of Two Tribes
Speakers: Chris Chapo
Link:

Summary

In this talk, Jon explores the often misunderstood relationship between data scientists and designers and how their collaboration can create significant customer value. Drawing on his experience at Intuit, he discusses developing an enterprise-wide A/B testing platform that initially struggled with adoption until working closely with designers to identify key leading metrics like platform ease of use and time to deployment, rather than just lagging outcomes. Jon also recounts a retail case where overwhelming daily data was distilled by studying top-performing store managers in context, enabling the team to design a focused dashboard that increased sales conversion by 10%. Lastly, he highlights eBay's approach to extracting meaningful signals from vast transaction data by partnering designers with 300 data analysts to streamline workflows and reduce insight time from weeks to a day, democratizing access across the company. He concludes that integrating data science fully into product teams alongside design and development creates more delightful, insight-driven products.

Key Insights

  • Less than 1% of global data is used to generate human insights, showing the value in efficient data utilization.

  • A data scientist combines statistical skills, hacking mindset, and entrepreneurial thinking to solve complex problems.

  • At Intuit, pairing designers with data scientists uncovered that ease of use and awareness were key to increasing adoption of an A/B testing platform.

  • Lagging indicators like number of experiments performed or features deployed are insufficient alone; leading indicators such as time to consumption and user awareness better drive adoption.

  • Ethnographic studies can reveal user behaviors and misalignments in what enterprise teams measure versus what actually drives business outcomes.

  • Studying the best-performing store leaders on the floor uncovered critical behaviors that informed a focused dashboard replacing overwhelming 424-page daily reports.

  • A simple data product tracking live customer-to-employee ratios, transaction progress, staff availability, and service queue length helped retail store managers improve performance and customer experience.

  • eBay’s approach to ‘signal extraction’ from massive data involves time series analysis, decision trees, and close designer-analyst collaboration to cut insight delivery from weeks to a day.

  • Democratizing data insights across an enterprise empowers broader decision-making beyond traditional analyst-only access.

  • Integrating data science as a core pillar alongside design, development, and product management can transform teams into more effective problem solvers and innovators.

Notable Quotes

"Since we started this presentation, enough data has been collected to fill everyone’s hard drive about 500,000 times, and fewer than 1% is ever used for insights."

"Data scientists are part stats geek, part hacker, and part entrepreneur."

"Develop deep customer empathy — really understand who’s using a product and why — walk a day in their shoes."

"Rapid experimentation with customers is key. Iterate, iterate, iterate."

"It doesn’t matter what the insight is if no one does anything with it."

"We realized we were measuring the wrong things — we focused on lagging indicators rather than the leading ones we could influence."

"Surprisingly, many developers didn’t even know our testing platform existed."

"By studying the best store leaders, we learned patterns that informed a dashboard reducing 424 pages of data to a few key, actionable metrics."

"eBay cut the time it took to get answers from weeks to one day by integrating design with data analysis workflows."

"Bringing data science into the core product process is like adding a fourth leg to the stool — design, development, product management, and data together create delight."

Ask the Rosenbot
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Noah Bond
Redefining truth and inclusivity: Navigating data ownership and ethical research in the age of disinformation
2025 • Advancing Research 2025
Gold
Chelsea Mauldin
Let's Talk About Money
2022 • Civic Design 2022
Gold
Vasileios Xanthopoulos
A Top-Down and Bottom-Up Approach to User-Centric Maturity at Scale
2024 • Enterprise Experience 2020
Gold
Alexis Lucio
Scaling Accessibility Through Design Systems
2022 • Design at Scale 2022
Gold
Brenna Fallon
Learning Over Outcomes
2019 • DesignOps Summit 2019
Gold
Jen Cardello
Standardizing Product Merits for Leaders, Designers, and Everyone
2018 • Enterprise Experience 2018
Gold
Dean Broadley
Not Black Enough to be White
2024 • DesignOps Summit 2020
Gold
Chloe Amos-Edkins
A Cultural Approach: Research in the Context of Glocalisation
2023 • Advancing Research 2023
Gold
Victor M. Gonzalez
Practicing Learners and Learning Practitioners
2021 • Advancing Research 2021
Gold
Jackie Ajoux
Leveling-Up: A Single-Player’s Guide to the DesignOps Team-of-One
2024 • DesignOps Summit 2020
Gold
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Ali Jeffery
How DesignOps Helped Enable Wall Street to Work Remotely
2020 • DesignOps Summit 2020
Gold
Emily DiLeo
Stronger Together: Lessons Learned from UX Research Ops
2024 • DesignOps Summit 2024
Gold
Uday Gajendar
Leading through the long tail of trauma
2022 • Advancing Research Community

More Videos

Doug Powell

"The user experience will allow us to win."

Doug Powell

Closing Keynote: Design at Scale

November 8, 2018

Mila Kuznetsova

"Recruiting kids really means recruiting adults as their proxies and gatekeepers."

Mila Kuznetsova Lucy Denton

How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices

March 9, 2022

Sarah Gallimore

"We created a Wizard of Oz smoke and mirrors prototype—a simple text message thread between a parent and this service—just to get enough buy-in."

Sarah Gallimore

Inspire Progress with Artifacts from the Future

November 18, 2022

Lada Gorlenko

"The ultimate measure is bringing value so people invite you back to work with them again and again."

Lada Gorlenko Sharbani Dhar Sébastien Malo Rob Mitzel Ivana Ng Michal Anne Rogondino

Theme 1: Discussion

January 8, 2024

Alnie Figueroa

"AI is just a better version of the tools you’re already using to refine ideas and express thoughts."

Alnie Figueroa

The Future of Design Operations: Transforming Our Craft

September 10, 2025

Landon Barnes

"Customers benchmark your company to their last best experience, often outside of your industry."

Landon Barnes

Are My Research Findings Actually Meaningful?

March 10, 2022

Emily Eagle

"Truly listening can push us beyond empathy to respect and reflection."

Emily Eagle

Can't Rewind: Radio and Retail

June 3, 2019

Malini Rao

"Designing for change means focusing on learnability and product consumability, not just ease of use."

Malini Rao

Lessons Learned from a 4-year Product Re-platforming Journey

June 9, 2021

Asia Hoe

"Product managers mean business — they have their hands in multiple pots long before designers join the team."

Asia Hoe

Partnering with Product: A Journey from Junior to Senior Design

November 29, 2023