Rosenverse

Log in or create a free Rosenverse account to watch this video.

Log in Create free account

100s of community videos are available to free members. Conference talks are generally available to Gold members.

Design and Analytics with Sarah Coyle
Thursday, July 30, 2020 • DesignOps Community
Share the love for this talk
Design and Analytics with Sarah Coyle
Speakers: Sarah Coyle
Link:

Summary

In this month's videoconference, Sarah Coyle chats with community curator Alison Rand and the DesignOps Community on: How to apply human centered design to analytics Types of measurement for design operations What to do if you don't have an analytics team

Key Insights

  • Measuring design value is impossible without clear context and defined questions.

  • Sarah transitioned from reactive data support to strategic design metrics development.

  • USAA’s design practice has nearly 300 people, centrally organized under one Chief Design Office.

  • Design operations at USAA includes analytics, recruiting, program management, and quality and risk.

  • Starting measurement with the question or goal leads to more meaningful data insights than starting with raw data.

  • Human-centered design principles improve the way analytics is approached and applied in design.

  • Education for both data creators and consumers is critical to mature design data practices.

  • Design research measurement focuses on whether research is happening and how it influences decisions.

  • Small teams without analysts can leverage passionate designers interested in analytics and cross-team collaboration.

  • Information (meaningful context-rich data) is more valuable than raw data points alone.

Notable Quotes

"I realized that measuring the value of design is an impossible question without context."

"Value of design is never going to get a single answer because you need the who, what, and why."

"I help teams start with questions about what they want to learn before looking at data."

"Data is just single points; information is making that data meaningful through context."

"Most requests started reactive but evolved into more strategic metric definitions."

"I train people on the difference between data and information and on asking the right questions."

"We are just starting to do regular and frequent reporting across the entire design organization."

"If you don’t have an analyst, find designers passionate about analytics and educate them."

"Human-centered design can bring curiosity and empathy into traditional analytics work."

"Information experience needs wayfinding so people can find and use data easily."

Ask the Rosenbot
Luca Rager
Empowering Gaming at Scale: How Xbox Builds Powerful, Automated, and Distributed Design Systems with Sketch
2021 • DesignOps Summit 2021
Gold
Sean McKay
Coexisting with non-researchers: Practical strategies for a democratized research future
2025 • Advancing Research 2025
Gold
Kevin M. Hoffman
Theme 2: Enterprise Team Journey
2019 • Enterprise Experience 2019
Gold
John Mortimer
Panel Discussion
2024 • Advancing Service Design 2024
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Joerg Beringer
Scaling User Research with AI: Continuous Discovery of User Needs in Minutes
2025 • DesignOps Summit 2025
Conference
Jeff Sussna
What DesignOps Can Learn From DevOps
2017 • DesignOps Summit 2017
Gold
Dave Malouf
The Future of DesignOps
2024 • DesignOps Summit 2020
Gold
Ron Bronson
Design, Consequences & Everyday Life
2022 • Civic Design 2022
Gold
Alberto Ferreira
Making it Count: Developing a custom digital metric framework that works
2021 • QuantQual Interest Group
Sahibzada Mayed
The Politics of Radical Research: A Manifesto
2023 • Advancing Research 2023
Gold
Gillian Salerno-Rebic
Redefining Speed and Scale: How Accenture’s GrowthOS Uses AI-Simulated Insights to Reduce Risk and Accelerate Innovation
2025 • Designing with AI 2025
Gold
Erin Hauber
Design is Not the Frosting on the Scaled Agile Layer Cake
2019 • DesignOps Summit 2019
Gold
Bas Raijmakers, PhD (RCA)
What Design Research can Learn from Documentary Filmmaking
2022 • Advancing Research 2022
Gold
Dan Willis
Enterprise Storytelling Sessions
2019 • Enterprise Experience 2019
Gold
Sean Baker
Weaving Knowledge Management into the Fabric of Our Design Practice
2025 • DesignOps Summit 2025
Conference

More Videos

Sam Proulx

"Low vision users often invert colors and use magnification levels as high as 400 percent to reduce eye strain."

Sam Proulx

SUS: A System Unusable for Twenty Percent of the Population

December 9, 2021

Michael Land

"In government, the org chart really matters – it influences who talks to whom and who gets to interface."

Michael Land

Establishing Design Operations in Government

February 18, 2021

Shipra Kayan

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Shipra Kayan

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

September 30, 2021

Ian Swinson

"Why don’t we do what we do for users but apply it to our own careers? Absolutely nutty, right? So we did."

Ian Swinson

Designing and Driving UX Careers

June 8, 2016

Isaac Heyveld

"The chief of staff is the bridge between our executive leadership team and the design ops practitioners."

Isaac Heyveld

Expand DesignOps Leadership as a Chief of Staff

September 8, 2022

Amy Evans

"Stepping into the shoes of design gave stakeholders a new admiration for the design process and strengthened our relationship."

Amy Evans

How to Create Change

September 25, 2024

Kate Koch

"Telepathy as mind reading means proactively building a talent pipeline and improving recruitment processes."

Kate Koch Prateek Kalli

Flex Your Super Powers: When a Design Ops Team Scales to Power CX

September 30, 2021

Dave Gray

"Most enterprises are not emotionally safe places; people can’t just leave emotions at the door."

Dave Gray

Liminal Thinking: Sense-making for systems in large organizations

May 14, 2015

Matt Duignan

"Durable insights can emerge organically based on usage and referencing patterns in the system."

Matt Duignan

Atomizing Research: Trend or Trap

March 30, 2020