Rosenverse
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Speakers: Marisa Bernstein
Link:

Summary

While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.

Key Insights

  • Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.

  • Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.

  • Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.

  • Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.

  • Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.

  • Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.

  • Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.

  • Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.

  • Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.

  • Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.

Notable Quotes

"If it doesn’t work for you, it doesn’t work."

"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."

"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."

"Participant experience is everything and it starts with building trust."

"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."

"Use plain language in all communication. No design or technology jargon."

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."

Ask the Rosenbot
Sarah Rink
Remote User Research: Dos and Don'ts from the Virtual Field
2020 • Advancing Research Community
Mansi Gupta
Women-Centric Research: What, Why, How
2023 • Advancing Research 2023
Gold
Mark Interrante
Collaboration Flows in Product Development
2017 • Enterprise Experience 2017
Gold
Jim Kalbach
Jobs To Be Done
2021 • Enterprise Community
Amy Bucher
Harnessing behavioral science to uncover deeper truths
2025 • Advancing Research 2025
Gold
Sarah Coyle
Design and Analytics with Sarah Coyle
2020 • DesignOps Community
Louis Rosenfeld
Discussion: What Operations can teach DesignOps
2017 • DesignOps Summit 2017
Gold
Matt Duignan
Atomizing Research: Trend or Trap
2020 • Advancing Research 2020
Gold
Kristen Honey
"Let’s Talk About Data and Crisis”: Public Digital Service Delivery = Open Data + Human Centered Design
2021 • Civic Design Community
Sohit Karol
Designing Delightful Listening Experiences: Mixed Methods Research in the Age of Machine Learning
2020 • Advancing Research 2020
Gold
Uday Gajendar
Theme One Intro
2023 • Enterprise UX 2023
Gold
Sydney Lawson
Anatomy of a Strong User Panel
2026 • Advancing Research 2026
Gold
Sahibzada Mayed
The Politics of Radical Research: A Manifesto
2023 • Advancing Research 2023
Gold
Ted Neward
Theme 4: Enterprise Organizational Journey
2019 • Enterprise Experience 2019
Gold
Justin Entzminger
Risk and Reward: How to Diversify the Field of Civic Innovators and Designers
2022 • Civic Design 2022
Gold
Shipra Kayan
Emerging principles for using AI in Design: What the product design team at Miro has learned from deeply integrating AI in their workflow
2025 • Designing with AI 2025
Gold

More Videos

Shanti Mathew

"Systems change happens at the human scale by making structures and humans visible so we can investigate and change them together."

Shanti Mathew Natalie Sims Natalia Radywyl

Civic Design at Scale: Introducing the Public Policy Layer Cake

December 9, 2021

Tess Dixon

"We need to reject the notion that work is our only identity."

Tess Dixon

C'mon Get Happy

September 29, 2021

Dave Hoffer

"Product design roles today usually expect a mix of interaction design and visual design skills."

Dave Hoffer Joanne Weaver

UX Job Search AMA #3 with Joanne Weaver and Dave Hoffer

July 16, 2025

Louis Rosenfeld

"Nobody’s going to ask to show you the $10,000 impact from a single design, but you can show the needle movement was there."

Louis Rosenfeld Jose Coronado Rachel Posman Guneet Singh Crystal Yan

The Bigger Picture: A Panel Discussion

October 23, 2019

Jon Fukuda

"You can be right without making others wrong by telling a story that respects their worldview."

Jon Fukuda

Storytelling for DesignOps

August 17, 2023

Jemma Ahmed

"Skin folk aren’t necessarily kinfolk — diversity doesn’t magically prevent inequitable research."

Jemma Ahmed Robert Fabricant Sean McKay Llewyn Paine Kate Towsey Noah Bond

Theme Panel

March 11, 2025

Kara Kane

"Legislation like the US executive order on federal customer experience has helped us rebuild trust in government."

Kara Kane

Theme One Intro

November 16, 2022

Tristin Oldani

"I realized I had too much chart junk and cognitive load, and users are left to decode instead of understand."

Tristin Oldani

Learning the Part I Used to Hand Off: How Building the Systems Made Me a Better Designer

August 20, 2026

Prayag Narula

"Users are smart, innovative, and a lot of the innovation actually comes from users rather than big companies."

Prayag Narula Rida Qadri

HCI 2.0: Humanity Deserves the Attention that UX Research has to Offer

March 28, 2023