Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle
Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team

Key Insights

  • Measuring design value is impossible without clear context and defined questions.

  • Sarah transitioned from reactive data support to strategic design metrics development.

  • USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • Human-centered design principles improve the way analytics is approached and applied in design.

  • Education for both data creators and consumers is critical to mature design data practices.

  • Design research measurement focuses on whether research is happening and how it influences decisions.

  • Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Jill Fruchter
Inconvenient Insights: The Researcher's Role is to Stay Curious
2023 • Advancing Research 2023
Gold
Elena Naids
The Power of Difficult Conversations: A Case Study on How We Introduced Design Ops in the Federal Government Space
2023 • DesignOps Summit 2023
Gold
Jen Cardello
Curating insight: Strategies for integrating knowledge across research functions
2025 • Advancing Research 2025
Gold
Kate Kalcevich
Integrating Accessibility in DesignOps
2024 • DesignOps Summit 2024
Gold
Louis Rosenfeld
Opening Remarks
2023 • Advancing Research 2023
Gold
Roberta Dombrowski
Making Research a Team Sport
2022 • Advancing Research 2022
Gold
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group
Deanna Zandt
The Unspoken Complexity of “Self-Care” with Deanna Zandt
2022 • Civic Design Community
Alnie Figueroa
Teamwork: Strategies for Effective Collaboration with Other Program Management Teams
2022 • DesignOps Summit 2022
Gold
Aletheia Delivre
New Shapes and Emerging Identities for Design Ops
2025 • DesignOps Summit 2025
Gold
Max Gadney
Assessing UX jobs for impact in climate
2024 • Climate UX Interest Group
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Sahibzada Mayed
The Politics of Radical Research: A Manifesto
2023 • Advancing Research 2023
Gold
Amy Thibodeau
Opening Keynote: Process and Ambiguity
2019 • DesignOps Summit 2019
Gold
Bria Alexander
Theme Two Intro
2023 • DesignOps Summit 2023
Gold
Steve Portigal
War Stories LIVE! Steve Portigal
2020 • Advancing Research 2020
Gold

More Videos

Shahrzad Samadzadeh

"The size of your role doesn't determine your impact; it's how your role fits into the bigger picture."

Shahrzad Samadzadeh

What Is My Value? Two Takes and Some Mistakes

January 8, 2024

Brenna Fallon

"If you forget the individual, you cut out psychological safety, which is the foundation for dependability and structure."

Brenna Fallon

Learning Over Outcomes

October 24, 2019

Ruzanna Rozman

"Flow is different for each person; you have to adjust your style based on who you work with."

Ruzanna Rozman

Getting in Flow with Your Team

January 8, 2024

Sheryl Cababa

"Systems thinking is not just about complexity but grounded in ethics to help deliver a better future for humans and the planet."

Sheryl Cababa

Expanding your Design Lens with Systems Thinking

March 28, 2023

Melissa Schmidt

"Customer understanding gives teams focus. Customer empathy gives purpose."

Melissa Schmidt Adam Menter

How UX Research Hit It Big in Las Vegas

June 4, 2019

Nathan Curtis

"If your organization is healthy, the haters pretty quickly get marginalized."

Nathan Curtis Nalini P. Kotamraju Jack Moffett Dawn Ressel

Discussion

June 9, 2016

Jake Burghardt

"Prioritizing top insights prevents stakeholders from getting lost in a sea of data."

Jake Burghardt

Stop wasting research: Create new value with insight summaries

July 9, 2025

Kate Towsey

"Synthetic users might be okay for finding average behaviors, but they won’t replace unique insights from real users."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Bria Alexander

"Cohorts are consistently one of the highest rated parts of the conference — they’re a fantastic way to learn together."

Bria Alexander

Opening Remarks

September 9, 2022