Rosenverse
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing

Gold
Thursday, December 9, 2021 • Civic Design 2021
Share the love for this talk
It Takes GRIT: Lessons from the Small, but Mighty World of Civic Usability Testing
Speakers: Marisa Bernstein
Link:

Summary

While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.

Key Insights

  • Inclusive usability testing uncovers user needs that would otherwise be missed, especially for vulnerable populations.

  • Building a diverse participant pool requires going offline to meet people in their everyday community spaces, not just digital recruitment.

  • Offering flexible testing times beyond standard working hours increases participation from diverse socioeconomic backgrounds.

  • Creating a comfortable, informal testing environment with snacks and a non-intimidating setting improves honest feedback.

  • Clear, jargon-free communication and early sharing of consent forms build trust and reduce participant anxiety.

  • Maintaining a single point of contact for participants prevents confusion and fosters smoother coordination.

  • Compensation at a rate of $1 to $1.25 per minute, reimbursed travel, and prompt payments boost recruitment speed and retention.

  • Referrals from satisfied testers can help reach specific demographics and expand testing pools efficiently.

  • Longitudinal testing, involving participants multiple times, enhances insights as the product evolves.

  • Testing with real users who rely on assistive technologies, like screen readers or voice commands, validates accessibility effectively.

Notable Quotes

"If it doesn’t work for you, it doesn’t work."

"When you test inclusively, you’re learning about the people who will be directly impacted by your work, your users."

"Technology that includes everyone, especially those from vulnerable populations, ensures that what gets built will work for everyone."

"Participant experience is everything and it starts with building trust."

"No surprises. Tell participants everything they’ll be experiencing from who will be in the room to if the session will be recorded."

"Use plain language in all communication. No design or technology jargon."

"Build your pool, build your practice. If you provide a great testing experience, you’ve got another person to add to your group."

"Compensation is so important to thank people for their time, and you will definitely build your recruitment pool much faster if you offer it."

"We intentionally did not email listservs or go on Twitter because that would have delivered a group that is too tech-savvy."

"During testing sensitive subjects, have relevant resources at the ready, like shelter beds for participants in need."

Ask the Rosenbot
Spencer L. A. Stultz
Why Social Justice Frameworks are Necessary for Successful DEI/JEDI Initiatives
2023 • DesignOps Summit 2023
Gold
Cennydd Bowles
Day 1 Panel
2024 • Designing with AI 2024
Gold
Discussion
2017 • Enterprise Experience 2017
Gold
Dantley Davis
Leadership & Diversity—A Fireside Chat with Dantley Davis
2020 • Enterprise Community
Catt Small
What's Next for ICs: Exploring Staff and Principal Designer Roles
2024 • Rosenfeld Community
Trisha Causley
[Demo] Complexity in disguise: Crafting experiences for generative AI features
2024 • Designing with AI 2024
Gold
Sheri Byrne-Haber
Accessibility at Scale
2021 • Design at Scale 2021
Gold
Noel Lamb
Cultivating Business Partnerships to Grow Research Ops
2022 • Advancing Research Community
Megan Blocker
Getting to the “So What?”: How Management Consulting Practices Can Transform Your Approach to Research
2024 • Advancing Research 2024
Gold
Amy Brana Stuart
Rest in Peace Fly-in-fly-out Design
2022 • Design at Scale 2022
Gold
Victor Udoewa
Radical Participatory Design: Decolonizing Participatory Design Processes
2021 • Civic Design 2021
Gold
Saara Kamppari-Miller
Key Metrics: Comparing Three Letter Acronym Metrics That Include the Word “Key”
2024 • DesignOps Community
Robin Beers
How to create actionable insight in the face of politics and silos [Advancing Research Community Workshop Series]
2023 • Advancing Research Community
Mujtaba Hameed
The new horizon of ethnography: using AI to unlock the full potential of in-person research
2026 • Advancing Research 2026
Gold
Michele Marut
Research Repositories Reconsidered
2019 • DesignOps Community
Onur Kocan
Understanding the Strategy for Civic Design in a Complex City: Istanbul
2022 • Civic Design 2022
Gold

More Videos

Adel Du Toit

"We only include products used by more than 50% of our employees in the quarterly survey to keep focus relevant."

Adel Du Toit

Get Your CFO To Say: 'Our Strategic Goal is User Obsession'

June 10, 2022

Saara Kamppari-Miller

"The hands is the part we love — action — to start doing things on your teams right after this Summit."

Saara Kamppari-Miller

Theme Three Intro

September 9, 2022

Savina Hawkins

"GPT is like a master chef who’s traveled the world sampling cuisines before creating new dishes."

Savina Hawkins

Harnessing AI in UXR: Practical Strategies for Positive Impact

March 26, 2024

Kate Towsey

"Research’s role may shift to orchestrators of AI-synthesized insights and gap analyses rather than just primary data collectors."

Kate Towsey Basel Fakhoury Oren Friedman Graham Gardner

Participant Recruitment and Management Tools

March 12, 2026

Monty Hammontree

"Closing the distance is about connecting not only with customers but also between cross-functional team members."

Monty Hammontree

The Future of UX Research

December 3, 2020

Meghan Bausone

"Maternal health is embedded within a healthcare industry prioritizing cost control, risk management, and standardization, not maternal safety."

Meghan Bausone

Systems Thinking and Design Innovation: Working with Leverage Points in Rural Maternal Health Systems

April 17, 2026

Nathan Curtis

"Don’t just think about design systems as an artifact but as a living ecosystem connecting people, tools, and products."

Nathan Curtis

Beyond the Toolkit: Spreading a System Across People & Products

June 9, 2016

Angelos Arnis

"AI can standardize work, but it's on the designer’s court now to bring humanity, emotion, and originality to the work."

Angelos Arnis

Navigating the Rapid Shifts in Tech's Turbulent Terrain

October 2, 2023

Allison Sanders

"If your purpose is just getting through 2020, that’s okay — survival can be the goal right now."

Allison Sanders

Operating with Purpose

January 8, 2024