Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle
Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team

Key Insights

  • Measuring design value is impossible without clear context and defined questions.

  • Sarah transitioned from reactive data support to strategic design metrics development.

  • USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • Human-centered design principles improve the way analytics is approached and applied in design.

  • Education for both data creators and consumers is critical to mature design data practices.

  • Design research measurement focuses on whether research is happening and how it influences decisions.

  • Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Andrew Webster
Scaling Design Capability: How Involved Should You Be?
2021 • DesignOps Summit 2021
Gold
Ali Jeffery
How DesignOps Helped Enable Wall Street to Work Remotely
2020 • DesignOps Summit 2020
Gold
Ilana Lipsett
Anticipating Risk, Regulating Tech: A Playbook for Ethical Technology Governance
2021 • Civic Design 2021
Gold
Samuel Proulx
Designing beyond caricatures: Embracing real, diverse user needs
2024 • Advancing Service Design 2024
Gold
Nick Cochran
Growing in Enterprise Design through Making Connections
2019 • Enterprise Experience 2019
Gold
Meredith Black
Building Community and Common Trends to Look for in 2021
2020 • DesignOps Community
Husani Oakley
Theme Two Intro
2023 • Enterprise UX 2023
Gold
JD Buckley
Communicating the ROI of UX within a large enterprise and out on the streets
2018 • Enterprise Experience 2018
Gold
Deanna Zandt
The Unspoken Complexity of “Self-Care” with Deanna Zandt
2022 • Civic Design Community
Boon Yew Chew
Making Sense of Systems—and Using Systems to Make Sense of the Enterprise
2023 • Enterprise UX 2023
Gold
James Lang
If you can design an app, you can design a community
2025 • Rosenfeld Community
Liwei Dai
The Heart and Brain of the AI Research
2020 • Advancing Research 2020
Gold
Shipra Kayan
Emerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow
2025 • Designing with AI 2025
Gold
Ovetta Sampson
Turning UX Passion into Real Product Influence
2023 • Enterprise UX 2023
Gold
Sarah Williams
Verizon_A Framework for CX Transformation
2024 • Design at Scale 2021
Gold
Harry Max
Prioritization for Leaders (2nd of 3 seminars)
2024 • Rosenfeld Community

More Videos

Uday Gajendar

"Grab that final drink and hang in there for one last thematic journey."

Uday Gajendar

Theme Four Intro

June 6, 2023

Jason Mesut

"Leadership Dichotomies are not opposites but spectrums where leaders find their dominant position and comfort range."

Jason Mesut Martina Hodges-Schell Jose Coronado

Unmasking Design Leadership: Navigating leadership without neglecting ourselves

October 30, 2025

Nathan Curtis

"Google’s Material Design has echoes of design decisions flowing through many of their applications."

Nathan Curtis

Beyond the Toolkit: Spreading a System Across People & Products

June 9, 2016

Jemma Ahmed

"Holding onto power too long might backfire because teams can make decisions without data, making you irrelevant."

Jemma Ahmed Steve Carrod Chris Geison Dr. Shadi Janansefat Christopher Nash

Democratization: Working with it, not against it [Advancing Research Community Workshop Series]

July 24, 2024

Ivana Ng

"Government expects us to establish large teams while also shipping software immediately."

Ivana Ng

Level Up Your Program with ProductOps

January 8, 2024

Sam Proulx

"Apple’s innovation with VoiceOver on iOS changed the world by making accessibility a built-in, first-party responsibility."

Sam Proulx

To Boldly Go: The New Frontiers of Accessibility

November 18, 2022

Daniel Gloyd

"Rather than problem solving, it’s conversation that should drive design."

Daniel Gloyd

Designing Warmth

February 26, 2025

Helen Armstrong

"Building skepticism into users is essential because if you’re not skeptical as a designer, it’s hard to build it into your customers."

Helen Armstrong

Augment the Human. Interrogate the System.

June 7, 2023

Kathleen Asjes

"Democratization can be used arrogantly if we just let others do research so we can pick what’s fun for ourselves — Jared Spool."

Kathleen Asjes

Research Democratization: the Good, the Bad and the Ugly

March 10, 2022