Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Speakers: Marisa Bernstein
Link:

Summary

While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.

Key Insights

  • Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.

  • Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.

  • Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.

  • Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.

  • Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.

  • Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.

  • Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.

  • Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.

  • Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.

  • Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.

Notable Quotes

"If it doesn’t work for you, it doesn’t work."

"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."

"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."

"Participant experience is everything and it starts with building trust."

"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."

"Use plain language in all communication. No design or technology jargon."

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."

Ask the Rosenbot
Taylor Klassman
Shaping the Next Era of UX Research: Collaborative Forum
2025 • Advancing Research 2025
Gold
Dr Chloe Sharp
Using Evidence and Collaboration for Setting and Defending Priorities
2023 • Design in Product 2023
Gold
Greg Petroff
Design is the Differentiator: Bringing New Design Innovations to a Very Antiquated and Very Large Industry
2021 • Design at Scale 2021
Gold
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis
2020 • Enterprise Community
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Jen van der Meer
Service design performs value
2025 • Advancing Service Design 2025
Gold
Jeff Gothelf
The Intersection of Lean and Design
2019 • Enterprise Community
Mark Interrante
AI for Prioritization (3rd of 3 seminars)
2024 • Rosenfeld Community
Aurobinda Pradhan
Introduction to Collaborative DesignOps using Cubyts
2022 • DesignOps Summit 2022
Gold
Nora Tejeda
Scaling Design Capabilities at BBVA Through a Self-service Design Model
2021 • Design at Scale 2021
Gold
Victor Lombardi
Bridging Design and Climate Science
2024 • Climate UX Interest Group
Aaron Stienstra
Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government
2021 • Civic Design 2021
Gold
Ariba Jahan
Team Resiliency Through a Pandemic
2024 • DesignOps Summit 2020
Gold
Sam Proulx
Everything You Ever Wanted to Know About Screen Readers
2021 • Design at Scale 2021
Gold
Mila Kuznetsova
How Lessons Learned from Our Youngest Users Can Help Us Evolve our Practices
2022 • Advancing Research 2022
Gold
Lukas Moro
“Feels Like Paper!”: Interfacing AI through Paper
2025 • Designing with AI 2025
Gold

More Videos

Elizabeth Sklar

"We are co-creating with the product organization to make sure everything fits seamlessly rather than being separate."

Elizabeth Sklar Jessica Sheng

Co-creating research enablement with your tech org: a case study

March 10, 2026

Saara Kamppari-Miller

"We use storytelling to turn accessibility from just compliance into a business differentiator that executives care about."

Saara Kamppari-Miller Nicole Bergstrom Shashi Jain

Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”

November 13, 2024

Gretchen Anderson

"No wiki in the world is as good as somebody who can come and tell you how to bend the rules a little bit."

Gretchen Anderson

Scaling the Human Center

June 8, 2017

Chelsea Mauldin

"We had to charge not just project work but all the costs including vacation, rent, insurance, and bookkeeping."

Chelsea Mauldin

Let's Talk About Money

November 17, 2022

Lada Gorlenko

"Taking care of ourselves first is essential before we can effectively care for others."

Lada Gorlenko

Theme 3: Introduction

June 10, 2021

Craig Villamor

"We’re really passionate about our craft but we’re not in control — that’s a shared hallucination we must give up."

Craig Villamor

Resilient Enterprise Design

June 8, 2017

Susan Simon-Daniels

"Never assume and always ask why."

Susan Simon-Daniels

War Stories LIVE! Susan Simon-Daniels

March 30, 2020

Robin Beers

"Building coalitions and embedding research insights within the culture is essential for long-term impact."

Robin Beers

Beyond Insights: Researchers as Organizational Change Catalysts

March 25, 2024

Paul Pangaro, PhD

"If you don't have shared language and values, you can't coordinate your actions or agree on what to do."

Paul Pangaro, PhD

Systems Disciplines: Table Stakes for 21st Century Organizations

June 6, 2023