Rosenverse
Design and Analytics with Sarah Coyle

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle

Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on:
  • How to apply human centered design to analytics
  • Types of measurement for design operations
  • What to do if you don't have an analytics team

Key Insights

  • •

    Measuring design value is impossible without clear context and defined questions.

  • •

    Sarah transitioned from reactive data support to strategic design metrics development.

  • •

    USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • •

    Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • •

    Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • •

    Human-centered design principles improve the way analytics is approached and applied in design.

  • •

    Education for both data creators and consumers is critical to mature design data practices.

  • •

    Design research measurement focuses on whether research is happening and how it influences decisions.

  • •

    Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • •

    Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Kate Towsey
ResearchOps AMA with Kate Towsey & Jake Burghardt
2025 • Advancing Research Community
Stephen Anderson
Puzzled? How to Coordinate Humans for Complex Challenges
2021 • Enterprise Community
Shipra Kayan
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
2021 • DesignOps Summit 2021
Gold
Kristin Wisnewski
Measuring What Matters
2019 • DesignOps Summit 2019
Gold
Catherine Blizzard
Using Integrated Insight to Drive Growth
2022 • Advancing Research 2022
Gold
Ian Johnson
Latent Scope: Finding structure in unstructured data
2025 • Designing with AI 2025
Gold
Bria Alexander
Opening Remarks
2021 • DesignOps Summit 2021
Gold
Peter Van Dijck
Coffee with Lou #4: Taking a Peek Under the Rosenbot's Hood
2024 • Rosenfeld Community
Mujtaba Hameed
Frameworks for Excellence: Using Visual Thinking and Communication to Elevate Your Research
2024 • Advancing Research 2024
Gold
Frances Yllana
D.E.A.R.R. Diaries (Discipline, Experience, Architecture, Reflection + Revolution)
2022 • Civic Design 2022
Gold
Steve Turbek
Designing Interactive Graphics with AI Code Help
2026 • Rosenfeld Community
Marc Fonteijn
Increase your confidence, influence, and impact (through a Professional Community)
2024 • Advancing Service Design 2024
Gold
Bria Alexander
Opening Remarks
2023 • DesignOps Summit 2023
Gold
Lija Hogan
Doing more with more: Lessons from the Front Lines of Democratization
2022 • Advancing Research 2022
Gold
Dawn Ressel
Full-Stack User Experiences: A Marriage of Design and Technology
2016 • Enterprise UX 2016
Gold
Surya Vanka
Unleashing Swarm Creativity to Solve Enterprise Challenges
2021 • Design at Scale 2021
Gold

More Videos

Susan Simon-Daniels

"I was ready to capture this fatal flaw that this fellow had discovered. It was so horrible it made him sigh. But it wasn’t."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Sharon Bautista

"Printing is not sexy but it is absolutely vital."

Sharon Bautista

Time to Make the Donuts: How User Research Helped Bridge Disparate Teams

January 8, 2024

David Cronin

"One sign of evidence that you've passed an inflection point is when you hire me as a consultant."

David Cronin Uday Gajendar Peter Morville Kendra Shimmell

Discussion

May 13, 2015

Jemma Ahmed

"Research is at a critical moment as relational dynamics between participants, organizations, and researchers shift from linear to plural and relational."

Jemma Ahmed Megan Blocker Eduardo Ortiz

Redefining the research toolkit: Expanding methodologies for a changing world

March 12, 2025

George Hinchliffe

"We ramped up from six-month release cycles to releasing every two weeks to keep ahead and still deliver experiences that wow."

George Hinchliffe Joy Liu

Delivering Amazing Experiences

June 10, 2021

Stefanie Owens

"What one government agency does often serves as the playbook for success at another."

Stefanie Owens

Optimizing for Outcomes: Transformation Design in Systems at Scale

December 4, 2024

Steve Baty

"Cultural shifts to experience-driven companies are less about creating new teams and more about creating a collective movement everyone owns."

Steve Baty Richard Dalton Maria Giudice Harry Max

Discussion

June 9, 2016

Ryan Matthew

"Figma files are no longer just a collection of visual elements; designers actively shape product features now."

Ryan Matthew Alex Kurchev

Bridging Design and Code: AI-Powered Design System Integration

September 11, 2025

Laura Weiss

"The alternate to engaging with conflict is suffering quietly or accumulating conflict debt."

Laura Weiss

Turn Down the Heat: 3 Ways to Handle Conflict in the Moment

November 20, 2024