Rosenverse
Design and Analytics with Sarah Coyle

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle

Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team

Key Insights

  • Measuring design value is impossible without clear context and defined questions.

  • Sarah transitioned from reactive data support to strategic design metrics development.

  • USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • Human-centered design principles improve the way analytics is approached and applied in design.

  • Education for both data creators and consumers is critical to mature design data practices.

  • Design research measurement focuses on whether research is happening and how it influences decisions.

  • Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Mohammad Hossein Jarrahi
Contextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
2023 • QuantQual Interest Group
Christian Bason
Expand—Rethinking Design for Public Challenges
2022 • Civic Design Community
Louis Rosenfeld
How to use the Rosenbot
2026 • Rosenfeld Community
Meredith Black
Building Community and Common Trends to Look for in 2021
2020 • DesignOps Community
Aleksandra Korczynska
Survey Tools
2026 • Advancing Research 2026
Gold
Jemma Ahmed
Theme Three Intro
2023 • Advancing Research 2023
Gold
Scott Jensen
Short Take #2: UX/Product Lessons from Your Industry Peers
2022 • Design in Product 2022
Gold
Sam Ladner
How Research Can Drive Strategic Foresight
2022 • Advancing Research 2022
Gold
Tamara Hale
War Stories LIVE! Tamara Hale
2020 • Advancing Research 2020
Gold
Peter Van Dijck
Hands on AI #3: Claude Code for UX people
2025 • Rosenfeld Community
Sam Ladner
Methodologies: Beyond the interview [Advancing Research Community Workshop Series]
2024 • Advancing Research Community
Mujtaba Hameed
The new horizon of ethnography: using AI to unlock the full potential of in-person research
2026 • Advancing Research 2026
Gold
Sam Proulx
SUS: A System Unusable for Twenty Percent of the Population
2021 • Design at Scale 2021
Gold
Tim Parmee
Changing Our Design Pressure Points
2023 • DesignOps Summit 2023
Gold
Ben Davies
Expert Panel: The Principles of Research Repository Design
2022 • Advancing Research 2022
Gold
Sam Proulx
Mobile Accessibility: Why Moving Accessibility Beyond the Desktop is Critical in a Mobile-first World
2022 • Advancing Research 2022
Gold

More Videos

Ross Smith

"Encourage everyone in the organization to read customer feedback and use data science tools like sentiment analysis to understand it."

Ross Smith

Breaking Barriers with Empathy

June 9, 2017

Kevin M. Hoffman

"Engineers are great at executing code but often lack connection to user experience and design processes."

Kevin M. Hoffman

Theme 2: Enterprise Team Journey

June 3, 2019

Ian Swinson

"If you’re amazing at your job but no one listens to your research or design, does it really have impact?"

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Sam Proulx

"At Fable, our platform lets you do generative and exploratory research with real assistive tech users remotely."

Sam Proulx

Understanding Screen Readers on Mobile: How And Why to Learn from Native Users

October 2, 2023

Briana Thomas

"Our effectiveness scale measured audience, purpose, documentation, cadence, effectiveness, participation, and culture to rate meetings."

Briana Thomas Christina Rodriguez

When Design Ops Comes in H.O.T. : A Tale of a Transformed Design Org

September 30, 2021

Prerna Makanawala

"Design talent is the most valuable asset; empowering them to be part of decisions retains and motivates them."

Prerna Makanawala

Achieving Balanced Design Consistency

June 9, 2021

George Abraham

"Changing branding and the look and feel should be possible with very quick and easy interactions, not taking another 10 weeks to customize."

George Abraham Stefan Ivanov

Design Systems To-Go: Reimagining Developer Handoff, and Introducing App Builder (Part 2)

October 1, 2021

Dana Bishop

"After redesign, the bank’s application ease of use improved, task success went up, and time on task dropped by a full minute."

Dana Bishop

2022: The Year UX Demonstrates its Business Impact

March 11, 2022

Jeff Gothelf

"Everyone has a customer — whether external users, third-party vendors, or internal colleagues; those humans consuming your product are your customers."

Jeff Gothelf

Who does what by how much?

November 20, 2025