Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle
Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team

Key Insights

  • Measuring design value is impossible without clear context and defined questions.

  • Sarah transitioned from reactive data support to strategic design metrics development.

  • USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • Human-centered design principles improve the way analytics is approached and applied in design.

  • Education for both data creators and consumers is critical to mature design data practices.

  • Design research measurement focuses on whether research is happening and how it influences decisions.

  • Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Sol Mesz
Hands or Brains? How to Hire for Strategy, Strategically
2024 • Enterprise Experience 2020
Gold
George Abraham
Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)
2021 • DesignOps Summit 2021
Gold
JJ Kercher
A Roadmap for Maturing Design in the Enterprise
2018 • Enterprise Experience 2018
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • Civic Design 2021
Gold
Mike Davidson
Fireside Chat
2022 • Advancing Research 2022
Gold
Dane DeSutter
Beyond the Console: The rise of the Gamer Experience and how gaming will impact UX Research across industries
2024 • QuantQual Interest Group
Louis Rosenfeld
Coffee with Lou: Should You Write a (UX) Book?
2024 • Rosenfeld Community
Mariesa Lenz
What Beekeeping Taught me about Product Teams
2025 • Rosenfeld Community
Amelia Cole
Data-Prompted Interviews
2021 • QuantQual Interest Group
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Iain McMaster
Design and Product: from Frenemy to Harmony
2023 • Design in Product 2023
Gold
Jemma Ahmed
Convergent Research Techniques in Customer Journey Mapping
2020 • Advancing Research 2020
Gold
Julie Gitlin
Design as an Agent of Digital Transformation at JPMC
2021 • Design at Scale 2021
Gold
Zen Ren
Taking Inspiration from Instructional Design for Research
2022 • Advancing Research 2022
Gold
Theresa Marwah
How Atlassian is Operationalizing Respect in Research
2020 • Advancing Research Community
Dan Hill
Strategic design, slowdown, and the infrastructures of everyday life
2022 • Enterprise Community

More Videos

George Aye

"Saying no shouldn’t be about being difficult but about accountability beyond any one person."

George Aye

That Quiet Little Voice: When Design and Ethics Collide

November 16, 2022

Xenia Adjoubei

"The tapestry exhibition will be a three-dimensional map co-created with refugees and local school kids to reflect their stories."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Benjamin Wiedmaier

"My time is more expensive than my money; fraudulent data wastes valuable time."

Benjamin Wiedmaier Annie Mayfield

Redefining Toolkits: Unbundling to Create a Perfect Match

March 11, 2025

John Devanney

"Impact evaluation is where organizations struggle the most, partly because metrics often don’t fit design’s multifaceted value."

John Devanney

The Design Management Office

November 6, 2017

Steve Sanderson

"The developer who refused to run experiments bragged about success, but it was actually a flop once we ran the test properly."

Steve Sanderson Alissa Briggs Jeff Gothelf Bill Scott

Discussion

May 14, 2015

Jemma Ahmed

"Imagine if everyone you worked with, regardless of the role, had deep empathy for your customers and made decisions based on those customer needs."

Jemma Ahmed

Theme 2 Intro

January 8, 2024

Megan Kierstead

"The more senior you become, the more focus shifts from methodology to interpersonal qualities like empathy and bravery."

Megan Kierstead

You Are a Badass at UX: Overcoming Imposter Syndrome

March 10, 2021

PJ Buddhari

"We have weekly meetings with implementation teams to design APIs, discuss progress, and address issues to ensure alignment."

PJ Buddhari Nate Baldwin

Meet Spectrum, Adobe’s Design System

June 9, 2021

James Lang

"Vanity metrics like membership numbers don’t tell you if the community is healthy."

James Lang

If you can design an app, you can design a community

May 22, 2025