Summary
While usability testing is an often overlooked part of design in the frenzied race to get technology to market, it’s absence is especially problematic when it comes to civic-focused products and services. Even when designers want to test, options are often limited to "professional testers" or personal networks - far from the actual users they’re hoping to help. Testing with a diverse group of end users and stakeholders is the only surefire way to make sure what gets designed works for everyone, but the approach needs to be thoughtful, sensitive and impactful. Since launching in early 2019, GRIT has delivered more than 20 such inclusive usability testing engagements with partners in the public, private and nonprofit sectors and we’re eager to share our insights with others who endeavor to engage diverse, underrepresented communities in the design of their civic products and services. Using case studies and lessons from our trove of civic design engagements, we'll help take the guesswork out of inclusively testing your next design.
Key Insights
-
•
Inclusivity in testing is crucial for designing effective public-serving technologies.
-
•
Diverse participant groups provide unique insights that can enhance product usability.
-
•
Creating a comfortable testing environment encourages open feedback from participants.
-
•
Compensation for participants increases engagement and recruitment success.
-
•
Building trust with testers is essential and should involve clear communication and consent management.
-
•
Recruitment should start early and leverage community connections for diverse representation.
-
•
Testing locations should be welcoming and not intimidating to participants.
-
•
Flexible scheduling can accommodate diverse participants, such as caregivers or those with non-traditional work hours.
-
•
Feedback loops show participants that their contributions matter, encouraging future participation.
-
•
Offering snacks and a relaxed atmosphere improves participant comfort and interaction.
Notable Quotes
"It's imperative that we recognize and honor the people that the plan belongs to."
"If it doesn't work for you, it doesn't work."
"When you test with a diverse group of residents, you learn things you never would have otherwise."
"Technology that includes everyone will ensure that what gets built works for everyone."
"Creating a positive experience for testers leads to better feedback and insights."
"We took a page from Cut Group's ebook and went offline."
"A big part of our success comes from providing a great testing experience."
"We try to accommodate people as much as we can."
"Building trust is key to conducting effective usability testing."
"It's essential to recruit before you need to test, not after."
More Videos
"It's critical for leaders in UX research to assert and position themselves strategically."
Sarah Alvarado Nalini P. Kotamraju Anne Mamaghani Peter MerholzHow to make UX research leadership more effective [Advancing Research Community Workshop Series]
October 26, 2023
"The key is to align teams with business outcomes rather than project outputs."
Jeff GothelfThe Intersection of Lean and Design
January 10, 2019
"You need an assistive technology user involved as soon as possible to understand the actual experience."
Sam ProulxUnderstanding Screen Readers on Mobile: How And Why to Learn from Native Users
March 27, 2023
"We want to keep the community alive to ensure regular exchange."
Ariel KennanCivic Design in 2022
January 13, 2022
"In the world of UX, metrics and design are beginning to coexist in more meaningful ways."
JD BuckleyCommunicating the ROI of UX within a large enterprise and out on the streets
June 14, 2018
"Designer happiness significantly impacts overall productivity and output quality."
Kristin Skinner Kamdyn Moore8 Types of Measures in Design Operations
April 16, 2020
"Dismantling any kind of martyr complex we live with is crucial."
Deanna ZandtThe Unspoken Complexity of “Self-Care” with Deanna Zandt
July 21, 2022
"I encourage you during breaks to engage with the provocation and see if it unlocks something for you."
Alana WashingtonTheme 1: Introduction and Provocation
January 8, 2024
"Incorporating interactive and engaging content is key for remote learning."
Nicole UmphressDelivering Design Education During a Global Pandemic: Lessons Learned
June 9, 2022
