Summary
While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusivity in testing is crucial for designing effective public-serving technologies.
-
•
Diverse participant groups provide unique insights that can enhance product usability.
-
•
Creating a comfortable testing environment encourages open feedback from participants.
-
•
Compensation for participants increases engagement and recruitment success.
-
•
Building trust with testers is essential and should involve clear communication and consent management.
-
•
Recruitment should start early and leverage community connections for diverse representation.
-
•
Testing locations should be welcoming and not intimidating to participants.
-
•
Flexible scheduling can accommodate diverse participants, such as caregivers or those with non-traditional work hours.
-
•
Feedback loops show participants that their contributions matter, encouraging future participation.
-
•
Offering snacks and a relaxed atmosphere improves participant comfort and interaction.
Notable Quotes
"It's imperative that we recognize and honor the people that the plan belongs to."
"If it doesn't work for you, it doesn't work."
"When you test with a diverse group of residents, you learn things you never would have otherwise."
"Technology that includes everyone will ensure that what gets built works for everyone."
"Creating a positive experience for testers leads to better feedback and insights."
"We took a page from Cut Group's ebook and went offline."
"A big part of our success comes from providing a great testing experience."
"We try to accommodate people as much as we can."
"Building trust is key to conducting effective usability testing."
"It's essential to recruit before you need to test, not after."
More Videos
"The only thing we did was every single word in the entire presentation were direct quotes from end users about the frustration they felt."
Discussion
June 9, 2017
"We're gonna close out the day with Silka Bcha, ALA Weinberg and Zaria Cameron discussing bettering ourselves."
Bria AlexanderTheme 1 Intro
September 23, 2024
"An all-in-one tool might not handle your emerging research questions well."
Benjamin Wiedmaier Annie MayfieldRedefining Toolkits: Unbundling to Create a Perfect Match
March 11, 2025
"Our goal was to create a design system that served as a single source of truth."
Eniola OluwoleLessons From the DesignOps Journey of the World's Largest Travel Site
October 24, 2019
"User-centered design resonates when our designers look like the community."
Justin Entzminger Terrance Smith Tracy M. Colunga Mai-Ling GarciaRisk and Reward: How to Diversify the Field of Civic Innovators and Designers
November 17, 2022
"This conference could not happen without our sponsors, so thank you."
Bria AlexanderOpening Remarks
October 4, 2023
"I still do this today. I make a service map when I know I need to grow a team fast."
Holly ColeUnderstanding Experiences: When you have to do more than work
November 8, 2018
"Simplicity is key for practitioners; they need actionable insights that can drive decisions."
Mohammad Hossein JarrahiContextuality problem: Exploring the Benefits of Qualitative and Quantitative Research
January 20, 2023
"The decision point given to product managers is really important."
Brad Peters Anne MamaghaniShort Take #1: UX/Product Lessons from Your Industry Peers
December 6, 2022
